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Introduction 


Standard  control  design  techniques  are  generall}^  based  on  the  knowledge  of  a  good  model  of  the 
system.  When  such  knowledge  is  missing,  for  example  when  the  system  is  unknown  or  time- 
varying,  it  seems  intuitive  to  combine  system  identification  techniques  with  control  methods. 
Adaptive  control  combines  both  approaclics  and  adapts  the  control  law  to  the  unknown  and 
possibly  time- varying  environment.  In  this  work,  we  are  mostly  concerned  with  pararntlric 
estimation  and  parametric  adaptive  control  of  linear  systems,  where  the  system  is  parameterized 
a.nd  only  parameters  need  to  be  determined.  Parametric  adaptive  control  techniques  for  single¬ 
input,  single-output  (SISO)  systems  assume  some  kind  of  a  priori  knowledge  about  tlie  system. 
Usually,  this  a  priori  knowledge  is  about  the  structure  of  the  system  like,  c.y.,  the  order  of 
the  system.  The  design  of  the  adajitive  controller  is  tlien  based  on  this  a  priori  structural 
knowdedge.  A  typical  adaptive  control  system  will  consist  of  a  control  law,  a  parameter  identifier 
using  measurements  of  the  input  and  tire  output  of  the  system,  and  an  adjustment  mechanism 
to  update  the  parameters  of  the  coatiollei'  based  on  the  identification.  A  general  repre^eutatiou 
of  an  adaptive  control  system  is  shown  in  Fig.  O.i. 

Adaptive  control  techniques  for  SISO  systems  have  been  extended  to  multivariable  (multi- 
input,  multi-output  (MIMO))  systems.  Similarly  to  the  SISO  case,  MIMO  parametric  adaptive 
control  schemes  rec[uire  a  priori  informaiion  about  the  structure  of  the  system.  However,  in  the 
MIMO  case,  this  required  a  priori  information  can  be  so  elaborate  that  it  greatly  reduces  the 
overall  applicability  of  current  MIMO  adaptive  control  techniques.  Furthermore,  current  MIMO 
adaptive  control  algorithms  often  do  guarantee  neither  stability  nor  parameter  convergence.  The 
main  objective  of  this  thesis  is  to  address  these  three  important  issues:  a  priori  information, 
stability,  and  parameter  convergence  in  MIMO  adaptive  control. 

0.1  Overview  of  adaptive  control 

In  the  past  years,  several  methods  have  Ireen  developed  for  designing  adaptive  controllers. 
These  techniques  can  be  separated  in  tvo  different  classes:  indirect  and  direct  adaptive  control. 
Indirect  adaptive  control  is  the  most  straightforward  approach.  It  consists  in  estimating  tlie 
parameters  of  the  transfer  function  of  the  process  or  the  parameters  of  a  state-space  represen¬ 
tation  of  the  process  (and  parameters  of  tlie  disturbances  when  stochastic  models  are  used). 
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Figure  0.1:  Adaptive  control  system 

Then,  the  controller  is  updated  based  on  the.  estimates  of  the  parameters  using  an  adjustment 
mechanism  corresponding  to  some  control  design  method  (c/.  Fig  0.1).  The  design  of  the  con¬ 
troller  is  independent  of  the  estimation.  Any  standard  design  technique  could  potentially  be 
considered.  The  adjustment  mechanism  is  often  a  complex  nonlinear  transformation  between 
the  estimated  parameters  and  the  controller  parameters.  In  contrast,  in  direct  adaptive  control, 
the  parameters  of  the  controller  are  estimated  directly.  In  that  ca.se,  the  estimator  updates  di¬ 
rectly  the  regulator  parameters  and  the  adjustment  mecha.nism  in  the  adaptive  control  system 
is  simply  the  identity  transformation. 

It  is  possible  to  classify  further  the  different  adaptive  control  techniques  by  the  t_ype  of 
control  law  used.  A  possible  classification  of  the  main  SISO  adaptive  controller  design  methods 
is  presented  in  Fig.  0.2.  A  well-known  technique  is  the  direct  or  indirect  model  rcjertnct  adaptive 
control  (MRAC).  In  this  scheme,  the  desired  output  of  the  closed-loop  s.ystem  is  specified 
through  a  reference  model,  and  the  adaptive  controller  tries  to  make  the  plant  output  match 
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Figure  0.2:  Adaptive  controller  design  techniques 


the  reference  model  output.  There  are  two  different  ways  to  implement  a  direct  MRAC  scheme: 
one  uses  the  output  error  (the  difference  between  the  output  of  the  plant  and  the  output  of 
the  reference  model)  and  assumes  that  the  reference  model  is  strictly  positive  real  (SPR),  [cf. 
Definition  1.5);  the  other  one  uses  the  so-called  input  error  (the  difference  between  the  inverse 
of  the  reference  model  applied  to  the  output  of  the  plant  and  the  reference  input)  and  does  not 
recjuire  such  assumption.  The  main  restriction  with  the  MR.AC  schemes  is  the  fact  that  they 
are  applicable  only  to  minimum  phase  systems  (systems  whose  zeros  are  in  the  open  left-half 
plane).  Another  popular  approach  used  with  deterministic  discrete-time  models  is  the  minimum 
prediction  error  adaptive  control,  where  the  control  law  attempts  to  minimize  a  cost  function 
based  on  the  square  of  the  error  between  the  predicted  output  of  the  closed-loop  system  and  the 
desired  output.  Often,  a  linear  combination  of  squared  future  commands  is  added  to  the  cost 
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function  to  reduce  the  amplitude  of  the  transients  and  avoid  saturation  of  the  input.  Discrete¬ 
time  MRAC  can  be  reformulated  as  a  particular  case  of  minimum  prediction  error  adaptive 
control,  where  the  desired  output  is  generated  by  a  reference  model.  Depending  on  the  cost 
function,  a  minimum  phase  assumption  on  the  system  may  or  may  not  be  required.  When 
stochastic  models  are  used  instead  of  deterministic  models,  this  type  of  technique  is  called 
minimum  variance  adaptive  control  In  the  literature,  minimum  variance  adaptive  control  is 
often  called  self-tuning  control.  Unfortunately,  the  term  self- tuning  control  is  also  used  to 
designate  minimum  prediction  error  adaptive  control,  indirect  adaptive  control,  or  sometimes 
any  method  different  than  MRAC.  Finally,  another  popular  method  is  adaptive  pole  placement, 
which  can  be  applied  to  minimum  phase  and  non-minimum  phase  systems. 

Conceivably,  indirect  adaptive  control  allows  the  use  of  almost  any  type  of  control  methods 
and  any  type  of  estimation  technique.  For  example,  it  is  possible  to  implement  adaptive  linear 
quadratic  (LQ)  and  linear  quadratic  gaiussiau  (LQG)  regula.tors,  or  simply  auto-tuning  PlD’s. 
However,  the  considerable  flexibility  of  the.  indirect  adaptive  control  approach  in  the  choice  of 
both  the  controller  and  the  identifier  is  greatly  offset  by  the  difficulty  to  guarantee  stabilit}'. 
Indeed,  for  most  of  the  indirect  adaptive  control  schemes,  either  sta.bility  is  not  guaranteed,  or 
the  reference  input  must  satisfy  sufficient  excitation  constraints  with  the  controller  parameters 
updated  only  when  adequate  information  has  been  obtained  from  the  identifier.  Estimates 
of  the  parameters  must  also  be  constrained  to  known  (possibly  disjoint)  convex  sets  in  which 
no  unstable  pole-zero  cancellations  occur.  Unfortunately,  to  recpiire  sufficient  excitation  in 
the  reference  input  is  often  not  realistic.  On  the  other  hand,  stability  can  be  guaranteed  more 
easily  for  (direct)  model  reference  adaptive  control  scliemes,  minimum  pi'ediction  error  adaptivt,* 
control  schemes,  and  minimum  variance  adaptive  control  schemes  (self-tuning  regulators),  with 
adecpiate  a  prion  structural  knowledge  but  witliout  any  particular  constraints  on  the  reference 
input  signals. 

Finally,  note  that  there  exist  severa.l  relatively  recent  books  studying  in  great  details  SISO 
adaptive  control  techniques,  e.g.,  the  book  by  Goodwin  &:  Sin  [1]  a.nd  the  book  by  Astrom  & 
Wittenmark  [2]  about  adaptive  control  of  discrete-time  deterministic  and  stochastic  systems,  or 
the  book  by  Sastry  &  Bodson  [3]  and  the  book  by  Narendra  &  Anna.swamy  [4]  about  adaptive 
control  of  continuous-time  systems. 


0.2  Multivariable  adaptive  control 

Survey  of  theoretical  results 

During  the  past  ten  years,  adaptive  control  techniciues  for  SISO  systems  were  extended  to 
multivariable  systems.  Several  MIMO  adaptive  control  algorithms  based  on  the  direct  model 
reference  approach  have  been  proposed.  Using  continuous-time  models,  Monopoli  &  Hsing  [5] 
first  presented  a  direct  MRAC  scheme  for  a  considerably  restricted  class  of  .M1.MO  systems. 
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Then,  Elliot  &  Wolovich  [6]  proposed  a  direct  MRAC  input  error  scheme  for  minimum  phase 
MIMO  systems,  Das  [7]  a  direct  MRAC  input  error  scheme  requiring  less  a  priori  knowledge 
on  the  system,  Tao  &  loannou  [8]  a  robust  input  error  scheme,  and  Singh  k  Narendra  [9,  10] 
a  direct  MRAC  output  error  scheme.  A  description  of  the  input  error  scheme  is  also  found  in 
the  book  by  Sastry  k  Bodson  [3],  and  of  the  output  error  scheme  in  the  book  by  Narendra 
k  Annaswamy  [4].  Discrete-time  deterministic  MRAC  schemes  were  proposed  by  Elliot  k 
Wolovich  [11],  Dugard  et  al.  [12],  Johansson  [13],  Ortega  et  al.  [14],  Das  [7],  and  assuming  that 
the  state  information  is  available,  Kim  k  Bien  [15].  Discrete-time  stochastic  MRAC  schemes 
can  be  found  in  Bittanti  k  Scattolini  [16],  Scattolini  k  Clarke  [17],  and  Scattolini  [18]. 

In  the  deterministic  discrete-time  case,  minimum  prediction  error  adaptive  controllers  were 
also  adapted  to  MIMO  systems.  Goodwin  et  al.  [19]  first  proved  global  convergence  of  some 
prediction  error  adaptive  control  algorithms  applied  to  a  class  of  MIMO  systems,  then  Goodwin 
k  Long  [20]  extended  the  previous  results  to  a  more  general  class  of  MIMO  systems.  Finally,  a 
modified  version  using  a  different  a  priori  information  was  proposed  by  Tsiligianuis  k  Svoronos 
[21]. 

In  the  stochastic  discrete-time  case,  MIMO  minimum  variance  adaptive  controllers  were 
first  proposed,  by  Keviczky  k  Hetthessy  [22]  without  stability  analysis,  for  restricted  classes  ot 
systems,  by  Borison  [23],  Koivo  [24],  Goodwin  et  al.  [25],  Keviczky  k  Kumar  [26],  Bayouini 
cl  al.  [27],  then  for  a  general  class  of  stochastic  systems  by  Dugard  et  al.  [28],  Han  el  al. 

[29] ,  Scattolini  k  Clarke  [17],  and  Scattolini  [18].  The  MIMO  minimum  prediction  error  and 
minimum  variance  adaptive  control  algorithms  are  also  described  in  the  book  by  Goodwin  k 
Sin  [1]. 

The  pole  placement  approach  was  investigated  in  the  stochastic  case  by  Prager  k  Wellstead 

[30]  a.nd  Mikles  [31],  and  in  the  deterministic  case  by  Elliot  et  al.  [32],  Djaferis  et  al.  [33],  Elliot 
k  Wolovich  [11],  and  Willner  et  a.l.  [34]. 

Several  auto-tuning  regulators  for  MIMO  systems  have  also  been  proposed,  e.f/.,  by  Davison 
[35],  Penttinen  k  Koivo  [36],  Jones  k  Porter  [37],  and  Miller  k  Davison  [38].  Finally,  we  should 
also  mention  that  a  paper  by  Dugard  k  Dion  [39]  surveys  direct  adaptive  control  methods  for 
MIMO  systems. 

Applications 

There  exist  several  applications  of  adaptive  control  to  multivariable  systems  in  process  control. 
Most  of  these  implementations  have  used  the  minimum  variance  adaptive  controller,  olteu  called 
self-tuning  regulator  (STR).  The  earliest  miplemeiitatiou  is  probaljly  the  application  ot  a  STR. 
to  a  cement  raw  material  blending  process  by  Keviczky  et  al.  [40].  A  STR.  has  also  been  used 
for  the  control  of  a  binary  distillation  column  by  Morris  et  al.  [41],  and  for  the  control  ot  a 
drum  boiler  by  Fessl  [42].  Simulations  with  a  STR  applied  to  various  processes  have  also  been 
made  and  are  described  in  papers  previously  cited:  application  ol  a  STR.  to  the  head-box  ol  a 
paper  machine  in  Borison  [23]  and  Koivo  [24],  to  a  hydraulic  system  in  Prager  k  Wellstead  [30], 


to  a.  binary  distillation  coluinn  in  Bittanti  Scattohni  [16],  and  to  an  aircraft  in  Kim  &  Bien 
[15],  A  minimum  prediction  error  adaptive  controller  has  also  been  applied  by  Martin-Sanchez 
k  Shah  [43]  to  a  binary  distillation  column. 

There  is  also  growing  interest  in  the  application  of  indirect  adaptive  control  schemes  to  flight 
control  systems,  in  particular  to  the  problem  of  reconfiguration  in  the  presence  of  failures, 
Dittmar  [44],  Morse  &  Ossman  [45],  Gross  k  Migyanko  [46],  and  Chandler  et  al.  [47].  Large 
space  structures  control  is  another  area  where  applications  of  multivariable  adaptive  methods 
are  expected  to  grow,  e.g.,  Bayard  et  al.  [48]  and  Bayard  [49]. 


0.3  Limitations  of  current  multivariable  algorithms 


0.3.1  Structural  information 

One  of  the  main  problems  with  the  current  parametric  methods  for  MIMO  adaptive  control  is 
the  amount  of  reciuired  a  pi'iovi  knowledge  aliout  the  structure  of  the  system.  A  typical  tiansfer 
function  for  a  continuous-time  deterministic  SISO  system  will  have  the  following  form 
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where  n  is  the  order  o[  the  system,  n  -  m  is  the  relative  degree  of  p(.s),  and  kp  is  the  high- 
frequency  gain.  Similar  definitions  hold  for  discrete-time  systems,  except  that  the  relative 
degree  is  called  time  delay  and  the  high-frequency  gain  is  called  time  delay  gam.  In  SISO 
MPv.AC,  minimum  prediction  error  adaptive  control,  and  minimum  variance  adaptive  control,  a 
priori  knowledge  consists  in  an  upper  bound  on  the  order  of  system  and  the  relative  degree  of 
the  transfer  function  for  continuous-time  systems,  or  the  time  delay  for  discrete-time  .systems. 


Furthermore,  knowledge  of  the  sign  of  the  high-frequency  gain  for  continuous-time  systems 
or  the  time  delay  gain  for  discrete-time  systems  is  also  often  reciuired  to  prove  stability.  For 
SISO  adaptive  pole  placement  algorithms  a,nd  for  most  indirect  adaptive  control  algorithms, 
the  required  a  priori  knowledge  is  the  order  of  the  system. 

In  MIMO  adaptive  control,  the  equivalent  a  priori  knowledge  is  much  more  complex.  The 
earliest  methods  dealt  with  the  problem  by  restricting  their  applicability  to  some  very  particu¬ 
lar  class  of  multivariable  systems.  Later  on,  the  first  direct  adaptive  control  (MRAC,  minimum 
prediction  error  adaptive  control  algorithms,  and  minimum  variance  adaptive  control)  algo¬ 
rithms  dealing  with  general  classes  of  system  were  developed.  They  required  the  full  knowledge 
of  the  Hermite  normal  form  or  the  interactor  matrix  (see  Definition  1.4),  and  also  the  knowl¬ 
edge  of  an  upper  bound  on  the  maximum  of  the  observability  indices  (see  Definition  1.6).  The 
knowledge  of  the  interactor  matrix  may  be  seen  as  ec[uivalent  to  the  knowledge  of  the  rela¬ 
tive  degree  or  the  time  delay  in  the  SISO  case.  Indeed,  the  interactor  matrix  becomes  simply 
(s  -I-  a)"“”‘  (where  a  is  an  arbitrary  positive  constant)  in  the  case  of  an  SISO  continuous-time 
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system  (0.1).  The  maximum  of  the  observability  indices  is  equal  to  the  order  of  the  system  in 
the  SISO  case.  MIMO  algorithms  are  found  in  the  papers  by  Goodwin  &  Long  [20],  Elliot  & 
VVolovich  [6],  Singh  &:  Narendra  [9,  10],  Elliot  &  Wolovich  [11],  Bittanti  &  Scattolini  [16],  and 
Scattolini  [18].  Furthermore,  to  guarantee  stability  these  algorithms  require  the  knowledge  of 
the  high-frequency  gain  matrix  (see  Definition  1.4)  or  the  knowledge  of  a  matrix  whose  product 
with  the  high-frequency  gain  matrix  is  positive  definite  (in  the  SISO  case,  this  is  equivalent  to 
the  knowledge  of  the  sign  of  the  high-frequency  gain).  Note  that  the  discrete-time  algorithm  in 
Goodwin  &  Long  [20]  does  not  explicitly  require  the  knowledge  of  the  time  delay  gain  matrix. 
However,  this  knowledge  will  be  necessary  for  a  practical  implementation  (see  Chapter  4). 

Additional  complexity  comes  from  the  fact  that  the  interactor  matrix  is  not  necessarily  a 
diagonal  matrix  with  known  polynomials  on  the  diagonal,  but  may  contain  off-diagonal  coeffi¬ 
cients  that  depend  on  the  unknown  parameters  of  the  systems.  Therefore,  requiring  the  a  priori 
knowledge  of  the  interactoi  matrix  often  makes  impractical  the  application  of  these  algorithms. 
In  recent  work,  the  full  knowledge  of  the  interactor  matrix  has  been  progressively  reduced  to 
the  knowledge  of  a  small  set  of  integer  values:  the  relative  degrees  or  delays  on  the  diagonal  of 
the  interactor  matrix  (which  can  be  seen  as  an  extension  of  the  relative  degree  or  the  time  delay 
in  the  SISO  case),  see,  e.g.,  Elliot  &  VVolovich  [11],  Johansson  [13],  Dugard  et  al.  [12],  Dugard 
et  al.  [28],  Scattolini  &  Clarke  [17],  Ortega  et  al.  [14],  Das  [7],  and  Dion  et  al.  [50].  However, 
stability  is  not  proven  for  these  algorithms,  or  it  is  implicitly  assumed  that  the  high-frequency 
gain  matrix  is  at  least  partially  known  (see  Chapter  5). 

Turning  to  direct  adaptive  pole  placement,  we  note  that  the  algorithms  proposed  by  Elliot 
et  al.  [32]  and  Willner  et  al.  [34]  require  the  a  priori  knowledge  of  the  controllahility  indices 
(see  Definition  1.7)  and  a  bound  on  the  maximum  of  the  observability  indices.  Other  direct 
adaptive  pole  plexemcnt  algorithms,  requiring  less  a  priori  knowledge,  either  are  limited  to  a 
particular  class  of  systems  (c/.  Prager  k  Wellstead  [30]),  or  are  not  guaranteed  to  be  stable 
(cf.  Djaferis  et  al.  [33]).  Indirect  adaptive  pole  placement  algorithms,  on  the  other  hand,  will 
require  the  knowledge  of  the  observability  indices  and  a  upijer  bound  on  the  maximum  ol  the 
controllability  iirdices  [cf.  Elliot  k  Wolovich  [11]).  Finally,  indirect  adaptive  control  algorithms 
generally  require  the  knowledge  of  the  observa-bility  indices. 

It  is  not  clear  how  the  structural  knowledge  (interactor  matrix,  observability  indices,  con¬ 
trollability  indices,  high-frequency  gain  matrix)  can  be  obtained  if  the  system  is  unknown.  The 
quantities  are  far  less  intuitive  than  SISO  indices  such  as  system  order  and  time  delay.  Quanti¬ 
ties  like  the  high-frequency  gain  matrix  and  the  non-diagona.l  elements  of  the  Hermite  normal 
form  (or  the  interactor  matrix)  depend  on  the  unknown  parameters  of  the  system.  Structural 
indices  like  the  observability  indices  or  the  controllability  indices  are  not  determined  by  more 
intuitive  indices  like  system  order,  time  delays  or  relative  degrees  of  the  elements  of  the  transfer- 
function  matrix.  It  is  often  argued  that  these  indices  generically  will  .satisfy  certain  constraints 
[e.g.,  all  observability  indices  are  equal  if  the  order  is  a  iirultiple  of  tlie  number  of  outputs). 
However,  real  systems  often  depart  from  genericity  because  of  strong  physical  constraints,  tor- 
example,  a  cross-coupling  term  in  a  transfer  function  matrix  that  is  a  true  zero  because  one  of 
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the  inputs  has  no  influence  on  one  of  the  outputs.  Cuvient  MIMO  fi.d?i.ptive  algorithms  requir¬ 
ing  less  CL  priori  information  often  do  not  guarantee  stability.  Therefoie,  the  applicability  of 
adaptive  control  to  unknown  multivariable  systems  is  limited. 


0.3.2  Parameter  convergence  and  robustness 

Even  when  stability  is  guaranteed,  another  problem  with  current  MIMO  direct  adaptive  con¬ 
trol  algorithms  is  that  parameter  convergence  properties  have  not  been  established.  In  fact, 
parameter  convergence  cannot  be  guaranteed  for  most  existing  algorithms  because  non-unique 
parameterizations  are  used.  In  parametric  adaptive  control,  the  controller  is  parameteiized  so 
that  a  vector  of  controller  parameters  corresponds  to  each  plant.  It  the  controller  parameters 
are  not  uniquely  defined  for  each  plant,  the  estimated  parameters  cannot  converge  to  unique 
values.  Even  if  the  input  signals  are  sufficiently  rich  (contain  enough  frequencies),  the  estimated 
parameters  will  not  converge  to  a  unique  value  but  will  converge  to  a  set  instead.  The  lack  of 
parameter  convergence  properties  is  a  potential  problem  for  the  robustness  of  these  schemes  to 
noise  and  unmodeled  dynamics.  Indeed,  since  the  set  to  which  tlie  parameter  converge  is  usuallv 
unbounded,  small  measurement  noise  and  unmodeled  dynamics  can  force  convergence  of  the 
parameters  to  regions  of  the  parameter  space  where  the  system  becomes  unstable.  Conversely, 
if  the  controller  parameters  are  uniquel}'  defined  and  the  inputs  sufficiently  rich,  the  pa.iame- 
ters  remain  in  the  neighborhood  of  their  nominal  value  and  a  certain  degree  of  robustness  is 
guaranteed  (c/.  Sastry  &  Bodson  [3]). 

In  indirect  adaptive  control,  the  coin’ergence  issue  has  an  ecpial  importance  for  the  lobus^- 
ness  of  the  algorithms.  Furthermore,  for  several  indirect  adajitive  contiol  schemes,  e.<y.,  indirect 
adaptive  pole  placement,  stability  will  not  be  guaranteed  unless  convergence  can  be  assured. 


0.4  Contributions 

The  unrealistic  amount  of  a  priori  knowledge,  the  lack  of  stability  proofs,  and  the  lack  of 
parameter  convergence  results  in  current  multivariable  adaptive  contiol  algorithms  prompted 
the  undertaking  of  the  research  presented  in  this  thesis.  The  decision  was  made  to  focus  on 
continuous-time  systems  since  results  obtained  with  continuous-time  adaptive  contiol  schemes 
can  often  be  transferred  to  the  corresponding  discrete-time  schemes  with  little  difficulty,  while 
the  reverse  is  not  true. 

1.  Parameter  convergence 

The  first  problem  addressed  in  this  thesis  is  that  of  parameter  convergence.  VVe  define 
identifiable  parameterizations  for  direct  MRAC,  direct  adaptive  pole  placement  (PPAC). 
and  for  a  recursive  identifier  (that  could  be  used  in  an  indirect  adaptive  control  scheme). 
The  word  identifiable  is  used  here  in  analogy  to  the  concept  of  identifiahility  in  parameter 
estimation.  A  parameterization  is  a  representation  of  a  class  of  systems  which  associates 
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a  vector  of  parameters  to  each  S3'stem.  For  a  linear  time  invariant  system,  one  will 
usually  says  that  a  parameterization  is  identifiable  if  each  transfer  function  corresponds 
to  a  unique  parameter  vector.  Similarly,  in  direct  adaptive  control,  the  controller  is 
parametrized  so  that  a  vector  of  controller  parameters  corresponds  to  each  plant.  Then, 
one  may  say  that  the  parameterization  is  identifiable  if  the  controller  parameters  are 
uniquely  defined  for  each  plant.  Once  an  identifiable  parameterization  has  been  defined, 
then,  assuming  that  the  adaptive  system  is  stable,  parameter  convergence  can  be  guar¬ 
anteed  if  persistency  of  excitation  conditions  are  met.  The  implication  of  the  results  on 
robustness  are  illustrated  with  an  example  that  shows  an  MRAC  system  with  noise  and 
unmodeled  dynamics  where  a  non-identifiable  parameterization  leads  to  instability  and 
an  identifiable  parameterization  docs  not. 

2.  Simple  frequency  domain  tests  for  parameter  converyence 

Another  contribution  of  thi.s  work  is  the  derivation  of  simple  frequency  domain  conditions 
on  the  inputs  that  guarantee  that  the  persistency  of  excitation  conditions  are  satisfied 
and  the  parameters  converge  to  their  nominal  va.lue.  An  importa.nt  difference  with  SISO 
systems  is  that  the  sufficient  condition  for  parameter  convergence  may  be  different  from 
the  necessary  condition.  Indeed,  parameter  convergence  may  depend  on  the  location  ot 
the  spectral  components  of  the  inputs.  The  frequency  domain  conditions  are  derived  for 
a  direct  MRAC  scheme,  a  direct  PP.AC  scheme,  and  a  recursive  identifier.  Although  the 
parameterizations  under  consideration  in  the  three  different  schemes  are  all  identifiable, 
they  have  different  numbers  of  parameters  and  requirements  for  parameter  convergence. 
Several  examples  are  presented  illustrating  the.se  differences  and  showing  cases  where  a 
direct  scheme  converges  and  an  indirect  scheme  does  not,  and  vice  versa.  The  so-called 
ecpiivalence  between  direct  and  indirect  schemes  is  found  to  be  more  complicated  than  it 
appears  from  the  SISO  case. 

3.  Stable  MRAC  with  unknown  high-frequency  (jain  matrix 

Another  important  contribution  of  this  work  is  the  relaxation  ot  the  rec]uirement  of  knowl¬ 
edge  of  the  high-frequency  gain  matrix  in  MRAC.  In  most  potential  applications  of  mul¬ 
tivariable  adaptive  control,  the  high-frequency  gain  matrix  depends  on  the  unknown  pa¬ 
rameters.  Therefore,  to  recjuire  its  knowledge  is  in  most  cases  an  unrealistic  constraint. 
If  we  assume  that  the  high-frecjuency  gain  matrix  is  unknown  and  is  estimated,  for  stabil¬ 
ity  reasons,  its  estimate  must  stay  nonsingular.  If  the  estimate  approaches  a  singularit\- 
region,  depending  on  the  type  of  MR  AC  scheme,  either  adaptation  may  stop  and  there 
is  a  possibility  of  instability,  or  the  control  law  may  become  undefined.  Our  result  is 
achieved  by  applying  a  particular  translormation  to  the  estimated  parameters  to  obtain 
the  controller  parameters.  This  translormation  does  not  modify  the  piopeities  o!  clas¬ 
sic  MRAC  algorithms  and  allows  us  to  prove  stability  without  requiring  knowledge  ol 
the  high-frequency  gain  (only  an  upper  bound  or  a  lower  bound  on  the  norm  ol  the 
high-frec[uency  gain  is  reejuired).  Illustrative  examples  show  that  the  para.mete.r  translor- 
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mation  is  absolutely  necessary  if  the  high-frequency  gain  matrix  is  unknown,  so  that  the 
singularity  of  the  estimate  of  the  high-frequency  gain  matrix  is  more  than  an  academic 
issue.  Indeed,  the  examples  show  MRAC  systems  whose  output  error  converges  with  the 
parameter  transformation  but  does  not  converge  without  it. 

4.  Stable  MRAC  with  unknown  Heimite  normal  form  or  interactor  matrix 

The  knowledge  of  the  full  Hermite  form  or  the  interactor  matrix  is  also  relaxed  to  the 
knowledge  of  the  relative  degrees  of  the  diagonal  elements  of  the  Hermite  normal  form. 
This  is  achieved  by  identifying  the  off-diagonal  elements  of  the  Hermite  normal  form  or 
the  interactor  matrix.  Further,  by  using  the  parameter  transformation,  we  am  able  to 
prove  stability  without  requiring  the  knowledge  of  the  high-frequency  gam  matrix  nor  the 
knowledge  of  the  interactor  matrix.  This  result  considerably  increases  the  applicability 
of  MRAC  to  multivariable  systems  with  respect  to  current  algorithms. 

5.  ObseTvability  and  pseudo-observability  indices 

Finally,  we  show  that  for  direct  MRAC,  direct  PPAC,  as  well  as  indirect  schemes,  the 
knowledge  of  the  observability  indices  can  be  replaced  by  the  knowledge  of  any  set 
of  pseudo-observability  indices  (see  Definition  l.G),  which  is  a  less  restrictive  require¬ 
ment.  Simple  criteria  for  the  identification  of  the  observability  indices  and  the  pseudo¬ 
observability  indices  are  also  presented  in  the  thesis.  These  results  were  obtained  by  work¬ 
ing  with  canonical  and  pseudo-canonical  matrix  fraction  descriptions  which  are  uniquely 
defined  for  a  given  system.  The  criteria  for  structural  identification  (identification  of  the 
canonical  and  pseudo-canonical  observability  indicc.s)  use  information  from  the  recursive 
identifier  to  decide  if  the  correct  structural  indices  have  been  selected.  Therefore,  on-line 
structure  selection  becomes  possible.  The  advantage  of  using  pseudo-observability  inclices 
is  the  fact  that  thev  define  overlapping  classes  of  systems  as  opposed  to  the  observability 
imlices  which  define  distinct  classes  of  systems.  Therefore,  the  pseudo-observability  in¬ 
dices  can  change  without  having  to  re-identify  completely  the  parameters  (by  a  similarity- 
transformation,  the  estimates  of  the  parameters  under  the  old  structural  indices  can  be 
transformed  into  estimates  under  the  new  structural  indices). 


0.5  Organization  of  the  thesis 

The.  thesis  is  divided  into  five  chapters.  A  brief  outline  of  the  content  of  the  chapters  is  as  follows. 
In  the  first  chapter,  concepts  from  mukivariable  system  theory  are  recalled.  Furthennuie, 
lesser  known  facts  about  canonical  and  pseudo-caiionical  forms  are  emphasized.  The  second 
chapter  presents  current  MIMO  adaptive  control  algorithms  and  their  properties.  A  direct 
MRAC  scheme,  a  direct  PPAC  scheme,  and  a  recursive  identifier  are  considered.  In  the  third 
chapter,  it  is  shown  how  to  define  identifiable  parameterizations  tor  the  three  schemes  under 
consideration  in  the  previous  chapter  (MRAC,  PPAC,  and  recursive  identification).  The  third 
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chapter  also  gives  the  frequency  domain  conditions  for  parameter  convergence  for  these  three 
schemes.  The  parameter  transformation  relaxing  the  MRAC  requirement  of  the  knowledge,  of 
the  high-frequency  gain  matrix  is  developed  in  the  fourth  chapter.  The  chapter  provides  also  a 
complete  proof  of  stability  of  the  MRAC  scheme  with  the  parameter  transformation.  Structure 
identification  is  presented  in  the  fifth  chapter.  It  is  shown  how  to  introduce  the  identification  of 
the  off-diagonal  elements  of  the  interactor  matrix  in  a  MRAC  control  scheme.  A  stability  proof 
is  given  without  requiring  knowledge  of  the  high-frequency  gain  matrix.  Finally,  criteria  for 
on-line  validation  and  selection  of  the  pseudo-observability  indices  and  the  observability  indices 
are  also  developed  in  the  fifth  chapter. 


li 


Chapter  1 

Multivariable  system  theory 


1.0  Introduction 

This  chapter  introduces  the  mathematical  notation  used  in  this  work  as  well  as  useful  properties 
and  definitions.  It  concentrates  on  results  and  definitions  related  to  multivariable  systems 
theory  and,  more  particularly,  multivariable  system  descriptions.  There  exist  three  different 
types  of  multivariable  system  descriptions.  Each  of  them  makes  up  a  section  of  this  chapter.  The 
first  is  the  transfer  function  matrix  description.  This  is  the  direct  transposition  of  the  notion 
of  transfer  function  in  .SfSO  systems.  The  very  important  concepts  ot  interaclor  matrix  and 
Hermite  normal  form  used  in  MIMO  M11.A.C  control  are  introduced  in  this  section.  The  second 
section  discusses  MIMO  state-space  descriptions.  This  section  also  recalls  the  definition  of  the 
observability  indices  and  the  controllability  indices  and  the  lesser  known  pseudo-observability 
indices  and  pseudo-controllability  indices.  These  structural  indices,  which  are  unique  to  MIMO 
systems,  are  very  important  for  the  structure  of  the  controllers  used  in  MIMO  parametric 
adaptive  control.  Further,  the  section  gives  some  canonical  forms  that  will  be  used  later  on 
to  define  identifiable  controllers.  Finally,  the  last  section  describes  matrix  fraction  descriptions 
which  allow  us  to  manipulate  matrices  of  polynomials  instead  of  matrices  of  rational  functions. 
Canonical  matrix  fraction  descriptions  are  also  described  in  the  section.  Furthermore,  it  is 
shown  how  they  relate  to  canonical  state-space  forms.  Generally,  more  details  may  be  found  in 
the  book  by  Kailath  [51]  on  these  topics,  except  for  pseudo-canonical  forms  which  are  described 
in  Correa  k  Glover  [52,  53]  and  Gevers  k  Wertz  [54].  Multivariable  parameterizations  and 
canonical  forms  are  also  presented  in  greater  details  in  de  Mathelin  [55].  For  the  reader  who 
is  not  very  familiar  with  multivariable  system  theory,  we  tried  to  alleviate  the  intrinsic  dryness 
of  this  chapter  by  introducing  numerous  examples. 


12 


1.1  Notation 


In  this  work,  P{s)  denotes  the  transfer  function  of  a  linear  time  invariant  operator,  P.  Then, 
P[u]  denotes  the  output  of  the  operator  in  the  time  domain  with  input  Furthermore,  the 

dependency  in  s  of  a  transfer  function  or  the  dependency  in  t  of  a  signal  will  be  often  omitted 
when  there  is  no  ambiguity.  Finally,  will  be  the  set  of  (p  x  m)  matrices  whose  elements 

are  rational  functions  of  s  and  will  be  the -set  of  (p  x  m)  matrices  whose  elements  are 

polynomial  functions  ot  s. 


1.2  Transfer  function  matrix  description 


The  transfer  function  matrix  is  the  direct  transposition  of  the  notion  of  transler  lunction  in  the 
single  input  single  output  (SISO)  case  to  the  multi-input  multi-output  (MIMO)  case.  An  m 
input  p  output,  linear,  time-invariant  system  can  be  described  by 

;V,(s)  =  P(.s)u(.s)  (i.l) 

where  P{s)  G  yy,,(.s)  is  the  Laplace  transform  of  the  output  of  the  system,  and  n(s) 

the  Laplace  transform  of  the  input.  P{.s)  is  the  transfer  fv.v.ction  matrix  of  the  system  and 
equation  (1.1)  is  called  a  transfer  functio  n  matrix  description  of  the  system. 

Definition  1.1  :  Proper  and  strictly  proper  transfer  function  matrix 
A  transfer  function  matrix  P{s)  is  proper  iff: 

lim  P{s)  exists 


and  is  .strictly  proper  iff: 


lim  P{s)  =  0 


Definition  1.2  :  Markov  parameters 

Let  P(s')  G  be  strictly  proper.  The  (p  x  m)  scalar  matrices  such  that: 

CO 

Pi,)  =  y 

t'=1 


(1.2) 


are  called  the  Markov  parameters  of  the  system. 


Based  on  the  above  definition,  the  Markov  parameters  can  be  computed  the  following  way: 


If  we  define  P{t)  as  the  impulse  response  of  the  system,  P{t)  =  £"^{P(s)},  then  by  the 
properties  of  the  Laplace  transform,  the  Markov  parameters  are  equal  to  the  value  at  the  origin 
of  P{t)  and  its  successive  derivatives: 


d'-' 


P{i)\t=o 


The  Markov  parameters  define  a  system  uniquely,  in  the  sense  that  for  one  set  of  Markov 
parameters  there  exists  only  one  system.  Also,  the  Markov  parameters  are  invariants  of  the 
system,  he.,  one  particular  sj'stem  has  only  one  set  of  Markov  parameters. 

Example:  the  2  x  2  transfer  tunction  inatiix 


m 


6^  4-35-  -f  36  4-  2  6  '  4"^ 

_ 1 _  5^4-35^  +  36-4-1 

+36  +  2  5^  +453+062+55  +  2 


i.s  strictly  proper  and  has  the  following  first  four  Markov  parameters 

3  1 

1  i 


(0)  0  hS^)  = 

■  1  -2  ■ 

/d^)  = 

_2 

1  1 

/d'^l  = 

0  1 

0  - 

-1 

J 

Definition  1.3  :  Hankel  matrices  and  order  of  the  system 
The  matrices: 


hi')  hi'+^) 

/,(.+!)  /jC+2) 


/d’M-1) 


(1.3) 


AC  +  J-L  .  /d'  +  2.7-2) 

where  the  are  the  Markov  parameters,  are  called  the  Hankel  matrices. 


The  infinity  Hankel  matrix  is  the  Hankel  matrix  H[o,co]  and,  like  the  Markov  parameters, 
uniquely  defines  the  system.  Finally,  the  order,  n,  of  the  system  is  the  rank  of  the  infinity 
Hankel  matrix. 


Definition  1.4  :  Hermite  normal  form,  interactor  matrix,  and  high-frequency  gain 
matrix 

Morse  [56]  showed  that  for  any  square,  strictly  proper,  and  nonsingular  plant  P{s)  e 
there  exists  a  unique  matrix  H(^s)  €  called  the  Hermite  normal  foim,  such  that. 

P{s)  =  H{s)U{s) 

U{s)  e  and  jim  t/(s)  = /ip  nonsingular 

r  _ I _  0  .  1 

^  Q 

=  (5  +  a)’"2-^  + 


L  '  ’  ■  (5-fa)^P  J 

where  dh,j{s)  <  r,  -  1  and  a  >  0  is  arbitrary,  but  fixed  a  priori..  The  matrix  Kj,  is  the  hiph- 
frcquency  pa.iri  matrix.  The  integers  /  ,■  extend  the  notion  ol  relative  degree  /  ot  an  SISO  translei 
function. 

It  ca.n  also  be  shown,  see  Sastry  &  Bodson  [3],  tirat  the  inverse  of  the  Heinnte  normal  loim 
i.s  the  iuteractor  rnatra:  ^{.s)  used  in  several  model  reference  adaptive  control  algorithms  {e.p., 
Elliot  k  Wolovich  [32]  and  defined  in  VVolovich  k.  Falb  [57]  a.s  the  (p  x  p)  polynomial  matrix 
such  that: 


with 


liiii  f(s)P(.s)  =  Hp  nonsingular 

e(.s)  =  (S'(.s)F(.s)^/)A(.s) 


0  t) 
cr2i(s)  0 


A(.s)  =  diag{(s +  «)'-■}  ns)  = 

F{s)  =  diag{(s  +  a); 

[  o-pi(s)  .  crpp_i(.s)  0  J 
It  was  also  shown  by  Das  [7]  that  the  elements  of  E‘(s)  are  zero  or  satisfy  the  condition 

E  (U--!))-!  r>J 

k~j-rl 


(1.4) 


Finally,  it  should  be  noted  that  Dion  et  al.  [50]  proved  that  the  bounds  given  in  (1.4)  are  the 
best  possible  ones.  In  the  sense  that  there  exist  systems  such  tliat  the  inequalities  m  (1.4) 
become  ecpialities. 


Example: 


given  the  following  2 


C(s) 


X  2  tr?onsfer  fuactioii  matrix 

_ 5 _ 

n''  -1-3^2  -J-3a  +  2  6'“^  -|-r>i2 

1  6  -j-  3  i»'2  -|-  3  A'  ~r 

6'^ +3 i’ 2  4-3 i  4-2  A-'*  4-4s^ 4-'>i'4' 2  _ 
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then 


N{3) 


1 

(s+a) 


0 


-0.5  1 

(5+a)  (5+a)2  J 


(s  +  a)  0 

0.5(5 +  a)2  {s  +  ay 


(S*(5)F(5)  +  /)A(5) 


0 

0.5 


0 

0 


(5  +  a)  +  I) 


(5  +  «)  0 

0  (5  +  ay 


Kr.  = 


0  -2 
0.5  —0.5 


Therefore,  ri  =  1,  ro  -  2,  and  it  can  be  checked  that  da2\  =  ('/  'i  -  1)  -  1  -  0. 


Definition  1.5  :  Positive  real  transfer  matrices 

A  p  X  p  matrix  P{s)  of  functions  of  a  complex  variable,  s  =  <t  +  ju  i.s  po.sitive  real  (PR)  il: 


•  P{s)  has  elements  that  are  analytic  V  <7  >  0, 


.  P*[S)  =  P(5-),  V  (T  >  0, 

•  P^(5‘)  +  P(s)  >  0,  V  a  >  0. 

Furthermore,  P(s)  is  strictly  positive  real  (SPR)  if  P{s  -  e)  is  PR  for  some  c  >  0. 

Comment:  For  a  rational  transfer  function  with  real  elements,  the  main  condition  to  be  SPR 
is  that  P{s)  must  be  stable  and  P'^iju)  +  P{ju)  >  0.  SPR,  transfer  functions  form  a  rather 
restricted  class  of  transfer  functions. 


1.3  State-space  description 

Given  a  m  input  p  output  strictly  proper  system  of  order  n  {cf.  Definition  1.3),  it  can  be  shown 
that  a  minimal  state-space  realization  has  the  foim 

X  —  Ax  +  Bu 
Vp  =  Cx 

where  x{t)  is  a  n  dimensional  state  vector,  A  €  J?""",  B  G  and  C  G  The 

state-space  realization  is  related  to  the  transfer  function  matiix  desciiptioii  by 

P{.s)  =  C{sl  -  A)-^B  (1-C) 
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There  exists  an  infinity  of  such  realizations,  related  by  nonsingular  state  transformations  (sim¬ 
ilarity  transformations).  Indeed,  assuming  that  T  is  a  (n  x  n)  nonsingular  matrix,  then 

A‘  =  T-^AT  C‘ =  CT 

define  another  minimal  state-space  realization  of  the  system  with  state  vector  x*  =  T~'^x. 
Definition  1.6  :  Observability  and  pseudo-observability  indices 

Suppose  that  0[C,  A]  is  the  (pn  xn)  observability  matrix  associated  with  the  minimal  realization 
{A,B,C}  without  redundant  outputs  (he.,  C  has  full  rank).  Then 

■  C 
CA 

_ 


Since  the  representation  is  minimal,  it  is  completely  observable  and  the  matrix  0(0,  A]  has  full 
rank  n.  Therefore,  one  can  select  n  linearly  independent  rows  ol  Cl[6',  A]  to  form  a  row  basis  for 
(9[6',  A].  There  exist  many  ways  to  select  such  a  row  ba.sis.  However,  we  can  limit  this  number 
by  first  imposing  that 

1.  Rows  1, .  .  .  belong  to  the  basis  (always  possible,  since  it  is  assumed  that  there  are  no 
redundant  outputs). 

2,  Row  (■<  —  p).  I  >  p,  belongs  to  the  basis  if  row  i  does  so  (also  always  possible). 


Given  these  two  constraints,  there  still  exist  several  potential  row  bases.  For  example,  \{  p  —  2 
and  n  —  5,  then  rows  {1,2, 3, 4, 5),  (1,2, 3, 4, 6),  {1,2, 3, 5, 7},  {1,2, 4, 6, 8}  are  potential  row- 
basis.  For  a  particular  system,  not  all  these  combinations  of  rows  are  necessarily  linearly 
independent.  However,  there  always  exists  at  least  one  of  those  combinations  of  rows  which 
forms  a  basis  since  the  system  is  completely  observable.  The  row  basis  can  be  characterized 
by  the  indices  {pi}  defined  as  the  total  number  of  rows  in  the  basis  associated  with  the  output 
y/p,.  For  example,  if  p  =  2  and  n  =  5,  then  the  row  basis  made  of  rows  {1,2, 3, 4, 5}  (3  rows 
associated  with  output  y/p,  and  2  rows  associated  with  output  y/p.^)  ca.n  also  be  characterized  by 
the  indices  {3,2}.  Obviously,  based  on  the  definition  of  the  indices  {p,},  1  <  p.  <  (n  -p  -f  1) 
and  X)/-i  Pi  —  "r'lie  numbers  {p,}  are  called  the  pscv.do-oliserv(i.bility  indices.  There  generally 
exist  several  choices  ol  pseudo-observabilit}'  indices  lor  a  jiarticular  system.  For  example,  it 
p  =  2  and  n  =  5,  the  pseudo-observ^ability  indices  could  be  one  or  several  of  the  sets  {3,2}, 
{2,3},  {4,1},  and  {1,4}. 

Now,  a  unic[ue  row  basis  can  be  defined  by  requiring  that 


3.  The  n  first  linearly  independent  rows  must  be  selected. 
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Then,  the  corresponding  set  of  indices,  denoted  {t'i},  a-re  simply  called  ohservahility  indices 
and  are  uniquely  defined.  Clearly,  one  of  the  sets  of  pseudo-observability  indices  is  the  set  of 
observability  indices. 

Finally,  it  can  be  shown  (see,  e.</.,  Kailath  [51],  Chapter  6),  that  the  sets  of  pseudo- 
observability  indices  and  the  observability  indices  are  invariants  of  the  system.  In  other  words, 
they  are  independent  of  a  particular  state-space  realization. 


Example:  given  the  s3'’stem  with  transfer  function  matrix 


P{s) 


5^  +  5  _2s5-7s2_7s_4 

s3+352+3i-r2  ii+4s3+<>5^+.Ss-|-2 

1  +3.5^ +.3^  +  1 

4-352 +35  +  2  ,44453+65245542  _ 


a  minimal  state-space  realization  is 


-7  -5 

3  4  1 

■  0  O' 

A  = 

3  3-2  3 

-17  -13  6  -10 

B  = 

1  -3 

-2  -1 

C  = 

'22-11' 
2  1-11 

-7  -7 

3  -6 

_  -3  3  . 

Therefore,  the  corresponding  observability  matrix 


0\C.A\^ 


2  2  - 1  1 
2  1-11 
2  2  -1  2 
-i  -1  1  -1 

—5  —5  2  —4 

-6  -4  2  -3 

14  12  -5  9 

17  13  -7  10 


It  can  be  verified  that  rows  {1,2, 3, 4}  are  linearly  independent,  as  well  as  rows  (1,2,  3,  5}  and 
rows  (1,2,4,  6}.  Therefore,  (2,2),  (3,1),  and  (1,3)  are  the  pseudo-observability  indices  of  the 
system.  {2,2}  are  the  observability  indices. 


Definition  1.7  :  Controllability  and  pseudo-controllability  indices 

Suppose  that  C[A,D]  is  the  (/i  x  mn)  controllability  matrix  associated  with  the  rmnim 
izatioii  {A,B,C]  without  redundant  inputs  (he.,  B  has  full  rank).  Then 


rcnl- 


C[A,B]  =  [  B  AB  ...  A’^-'^B 


Since  the  representation  is  minimal,  it  is  completely  controllable  and  the  matrix  C[A,B]  has 
full  rank  n.  Therefore,  one  can  select  n  linearly  independent  columns  oi  C[A,  B]  to  form  a 
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column  basis  for  C[A,B\.  By  selecting  the  columns  of  the  controllability  matrix  according  to 
similar  rules  than  when  selecting  the  rows  of  the  observability  matrix,  one  can  define  sets  of 
pseudo-observability  indices,  {/c,}  and  a  unique  set  of  controllability  indices,  Again,  the 

sets  of  pseudo-controllability  indices  and  the  controllability  indices  are  invariants  of  the  system. 

Example:  given  the  system  with  the  minimal  state-space  realization  from  Definition  1.6,  the 
corresponding  controllability  matrix 


C[A,B]  = 


0  0  1  0  -2  -1  3  3  ■ 

1  -3  -2  2  2  0  -2  -2 

-2  -1  5  3  -11  -8  22  19 

-3  3  5  0  -8  -5  15  13  . 


It  can  be  verified  that  columns  (1,2,  3, 5}  are  linearly  independent,  but  columns  {1,2,  3, 4}  and 
columns  (1,2, 4, 6}  are  not  {AB2  -f  -f  Bz  =  0  where  Bi  is  the  z-th  column  of  B).  Therefore, 
{3, 1}  are  the  only  pseudo-controllability  indices  of  the  sy.stem,  and  are  also  the  controllability 

indices. 


Definition  1.8  :  Observability  and  pseudo-observability  canonical  forms 

The  state-space  realization  {Aj,oy,  B,o,j,C,,y]  obtained  by  applying  to  any  minimal  realization 

{A,B,C},  the  state  transformation  T  =  Q-'^[C,A\,  where  Q[C,A]  is  defined  by 


Cl 

C,A 


QIC,  A]  = 


Ci/1^'-' 

Cz 


Cj,A^^ 


where  C,-  is  the  z-th  row  of  C,  is  called  a  pseudo-observability  canonical  form.  If  the  observability 
indices  are  known  and  the  {p,}  are  replaced  by  the  {r,}  in  Q[C,  A],  then  the  resulting  realization 
{Aoy,  Boy,Coy}  is  the  observability  canonical  foi'in.  Clearly,  one  of  the  pseudo-observability 
canonicaTform  is  identical  to  the  observability  canonical  form.  It  can  be  shown  (see,  e.y.,  Correa 
k  Glover  [52,  53])  that  the  pseudo-observability  canonical  form  has  the  following  structure 

Cjxn,  =  block  diag  |  |  1  0  •  •  •  0  j  ,  (1  X  p,),  ?•  =  1, . . . ,  | 


/ 

0 

0 

0  ' 

0  0  1 

...  0 

block  diag  < 

0  . 

0  1 

,(p,  X  P.),i=  l,...,p  > 

0  . 

0 

0 

> 
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+block  diag  <  ^  ,  {pi  X  1),  z  =  1, . . . 


Bpoy  — 


MV  •••  Mt 


<^110  ' 
<^210  • 


<^120 

<=^2l{pi-l)  ^220 


^lp{Pp-l) 

^2p(pp-l) 


^pl(pi-l)  ^p20  ■**  ^pp(^p-l) 


where  the  niatiices  are  the  Markov  paranreters  ot  the  S3^istein  and  the  coefficients 
such  that  ^ 

-EE 

j=i  A— a 

for  all  minimal  state-space  realizations  {A,B,C}.  Furthermore,  it  can  be  shown  (see,  e.y., 
Correa,  k  Glover  [52,  53])  that  the  coefficients  apr  are  invariants  for  a  given  set  of  pseudo¬ 
observability  indices.  Consequently,  for  a  given  system  there  e.xists  a  fixed  number  of  sets  ot 
pseudo-observability  indices  and  tor  each  ot  these  sets  there  exists  only  one  pseudo-observability 
canonical  forin. 

The  observability  canonica.1  form  is  identical  to  the  pseudo-observability  canonical  form  it 
the  {[h]  are  replaced  by  {//,}.  However,  knowing  that  the  observability  indices  are  {i/.}  implies 

that  .  .  . 

_  P  [  ^' >  min(i/,,  i^j)  and  j>i 

~  ^  >  min(;/{  +  and  j  <  i 

For  a  given  system  there  will  exist  only  one  observability  canonical  form. 

For  example,  if  rn  =  2,  p  =  3,  n  —  6,  {pt}  =  {3, 1,2),  then 

'  1  0  0  0  0  0' 

c,,,  =  0  0  0  1  0  0 

_  0  0  0  0  1  0  _ 

r  0  1  0  0  0  0  '“n 

0  0  1  0  0  0  “11 

l(3)  l(3) 

^  _  criio  CTni  Q:n2  <^120  0:130  O'lsi  g  _  'hr  "'12 

0:910  0:211  0:912  O220  0:2.30  0:931  ^  ''  ^^22 

0  0  0  0  0  i  /,F)  /,(!) 

.  0310  0:311  a'3i2  O320  O330  O331  J  ^  (2)  ^(2) 

L  ol  oZ 
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and  if  {ui}  =  {3, 1,2},  then 


Coy  =  a 


poy 


A, 


oy 


0 

1 

0 

0 

0 

0  ■ 

0 

0 

1 

0 

0 

0 

0:110 

Olll 

on2 

O120 

Ol30 

Oi31 

O210 

0211 

0 

O220 

0230 

0 

0 

0 

0 

0 

0 

1 

O310 

0311 

0312 

O320 

O330 

0331 

B, 


oy 


poy 


In  the  case  of  the  system  given  as  example  in  Definition  1.6 

_  +  i  _2s-^-7i2_7j-4 

I  5-H 

P(s)  = 


5'"^ +35^+35  +  2  5^+45^+65^+554-2 

5^  +35^  +  35  +  1 


5^  +35“  +35+2  5"'  4-4s'*  +65^  +55+2  J 

the  pseudo-observability  indices  are  {2,2},  {3,1},  and  {1,3},  and  the  obseivability  indices 
{2,2}.  The  observability  canonical  form  (which  is  ecpial  to  tlie  pseudo-observability  canonical 
form  with  indices  {2,2})  is  given  by 


■  0 

1 

0 

0 

* 

■  1 

-2  ■ 

-1 

_2 

0 

-1 

_2 

1 

^'T  _ 

'  1 

0 

0 

0  ■ 

Aoy  — 

0 

0 

0 

1 

Boy  = 

0 

1 

^  <>y 

0 

0 

1 

0 

_  -1 

-1 

_2 

_2 

- 

0 

-1  , 

pseudo-observability  canonical  lorm  with  indices 

{3,1} 

IS 

'  0 

1 

0 

0  1 

■  1 

-2  ■ 

0 

0 

1 

0 

Byoy 

-2 

1 

'  1 

0 

0 

0  ■ 

A  — 

-1 

-4 

-4 

2 

3 

1 

_ 

poy 

0 

0 

0 

1 

_  -1 

-2 

-1 

0  , 

0 

1 

The  pseudo-observability  canonical  form  with  indices  {1,3}  is 


■  -1 

-2 

-2 

-1  ■ 

■  1 

-2  ■ 

^poy 

0 

0 

0 

0 

1 

0 

0 

1 

^  [)(>y 

0 

0 

1 

-1 

’  1 

0 

0 

I 

0 

0 

0  0 

\ 

0 

_2 

-3 

-3  . 

_  1 

1 

Definition  1.9  ;  Controllability  and  pseudo-controllability  canonical  forms 

The  state-space  realization  BycyX'vcy]  obtained  by  applying  to  any  minimal  realization 

{A,B,C},  the  similarity  transformation  T  =  R-'^[A,B],  where  R{A,B]  is  defined  by 

R.[A,B]=\Bi  AB,  ...  A^^-^Bi  B2  ... 
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wliGrc  JBi  is  the  z-tli  column  ot  5,  is  ca-llsd  3.  pscudo-coTitrollubility  cunoniccil  fomi.  If  the 
controllability  indices  are  known  and  the  {^^i}  9-re  replaced  by  the  {/ii}  in  then  the 

resulting  realization  {^Acy,  BcyiCcy]  is  the  controllability  canonical  form.  It  can  be  shown  that 
the  pseudo-controllability  canonical  form  has  the  following  structure 


Bpey  =  block  diag 


Ajicy 


C  jiry 


1 

0 

0 


,(k,-  X  l),t  =  > 


block  diag  { 


0  0 

1  0 

0  ■  ■  • 

0  •  •  ■ 


.  0 

.  0 

1  0  0 
0  1  0 


-f 


Pi 


Pi 


no 

Pin\0 

—  1) 

120 

~l) 

PuilK) 

l)lock  diag{ 

[o  ■ 

0  1  ]  ,(1  X  K, ■):*■=  1>-- 

. . ,  in 

Pill/fi 

uW  ... 

^12 

•  ■  - 

“-pi 

'Ur/i 


where  the  matrices  /dd 
such  that 


are  the  Markov  parameters  of  the  system  and  the  coefficients  p^jk  are 

rn  1 

=  E  E 


j~l  JL-=0 

for  all  minimal  state-space  realizations  {A,  Furthermore,  the  coefficients  pijk  ^re  invaii- 

ants  for  a  given  set  of  pseudo-controllability  indices. 

The  controllability  canonical  form  is  identical  to  the  pseudo-coiitiollabihty  canonical  ioini 
if  the  {k,}  are  replaced  by  {//.,}.  However,  in  the  case  of  the  caiionica.l  form,  it  can  also  be 

deduced  that 


k  >  min(//i,//j)  and  j  >  i 
k  >  mln(/£{  -f  J  ^ 
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In  the  case  of  the  system  given  as  example  in  Definition  1.6 


7’(s)  = 


5^4-5  —25^  —75^—75  —  4 

53  4_332  +35+2  +45^  +652  4-55+2 

1  5^+352+35+1 

5^+352  +35+2  5^+45^  +652  +5 5+2  _ 


the  pseudo-controlls/bility  3.nd  controllcibility  indices  cire  *[3,1}'.  The  controll^ibihty  c3-noniCcil 
form  (which  is  also  the  pseudo-controllability  canonical  form  with  indices  {3, 1})  is  given  by 


1 

■  0 

0 

-2 

0  ■ 

■  1 

0  ■ 

11 

u 

1 

0 

0 

1 

-3 

-3 

0 

0 

Bey  = 

0 

0 

0 

0 

.  0 

0 

-1 

-1  _ 

_  0 

1  . 

1.4  Matrix  fraction  description 


Given  cin  tn  input  p  output  s3fsteni  of  orclei'  n  with  tranatei'  function  matiix  P{f')  €  ^ 

matrix  fraction  description  (MFD)  of  the  system  is 


lh{s)  =  D^(s)-DVx,(.s)n(.s)  =  NR{s)Dfd{s)u{s)  =  P{s)u{s) 


(1.7) 


where  Dr{s)  C  SR;-xp[^v]^  A7^(3)  ^  Dn[s)  G  and  N r{s)  G  Further¬ 

more,  {N l{s) ,  D l{,s)]  is  called  a  left  matrix  fraction  description  (MFD)  of  the  system,  and 
{Nr[s),Dr{s)}  a  right  MFD.  MFD’s  are  not  unique.  Indeed,  if  we  multiply  on  the  left  (right) 
a  left  (right)  MFD  by  a  iionsingular  polynomial  matrix,  we  get  another  left  (right)  MFD, 


Definition  1.10  :  Row  and  column  degrees,  row  and  column  reduced  matrix 
Let  D{s)  G  Let  dr,D  denote  the  maximum  polynomial  degree  in  the  r-th  row  of  D(.s), 

and  dc,D  the  maximum  polynomial  degree  in  the  z-th  column  of  D{s).  Then,  3  two  unique 
real  {k  x  k)  matrices  Tr[D]  and  LJ/)],  such  that  Va  G  3?,  (arbitrary) 


D{s) 


Sr{3)Tr[D]  +  D,.{s) 
rc[D]5c(.-s)  +  Dc{s) 


Sr{s)  =  diag'l  (s  +  |  Sc(s)  =  diag  |  (s  +  | 

where  Z},(6')  and  Z7c(.s)  are  polyuoiina!  iiiatriccs  with  lowei  degic.*e  teims  such  i,h<'.s. 


dr,  Dr  <  dr,D 
dc,D,  <  dciD 


The  coefficients  dr,D  are  called  the  row  degrees  of  D{s)  and  the  coefficients  dc,D  the  column 
degrees  of  D{s).  The  matrix  F^D]  is  called  the  leading  row  coeffi.cient  matrix  of  D{s)  and  F c[P] 
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the  leading  column  coejficient  matrix  ot  ^(•s)- 
This  result  is  illustrated  by  the  following  example; 


D{s)^ 


2s2-3  +  3  3s -2 

5^  +  1  2 


r.[D] 


2  0 
1  0 


2s2  +  4s  +  2  0 
s2  +  2s  -f  1  0 


-5s +  1  3s -2 
-2s  2 


(^  +  1)^ 

0 

'20' 

4- 

'  -5s +  1  3s -2  ' 

0 

(s  +  1)2  _ 

1  0 

-2s  2 

r,[D] 


2  3 
1  0 


‘  2s2  +  4s  +  2 

3s  +  3  ' 

+ 

— 5s  “f-  1  — 5 

_  s2  +  2s  +  1 

0 

—  \ 

CM 

CM 

1 

_ 1 

2  3  ' 

■  (-s  +  1)'^ 

0 

i 

■  -5s  +  1  -5  ' 

1  0  _ 

0 

(•^  +  1) . 

_r 

-2s  2 

A  polynomial  matrix  D{s)  is  said  to  be  roir  (column)  reduced  U  its  leading  coefficient  matrix 
r,-[D]  (Tcf/)])  is  noiisii^gular.  For  example. 


D(s) 


9^.2  _  +  3  3,c  -  9 

.4^  +  1  2 


lA[/2] 

rc[-D] 


2  0 
1  0 

2  3 

i  0 


is  column  reduced  but  not  row  reduced. 

It  can  also  be  shown  that,  if  D[s)  is  row  (column)  reduced  then 

clegdet{Z){s)}  =  ^duiD  (y~)  dcjD) 

1  i 

and  if  D{.s)  is  not  row  (column)  reduced 

degdet{Z}(s)}  (E'^^c^T)) 

Property  1.1  :  Strictly  proper  MFD 

Let  {Nc{s),  Diis)]  be  a  left  MFD  of  F(s),  and  {AT(.^),  ^  nglA,  MFD,  then 

CM  strictly  proper  ^  |  ^ 
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Furthermore,  if  Di{s)  is  row  reduced  and  Dr{s)  column  reduced,  then 


P{s)  is  strictly  proper 


dviNi  <  driDt  Vz 
dciNn  <  dciDfi  Vi 


Definition  1.11  ;  Coprime  MFD 

A  left  (right)  MFD  is  said  to  be  coprime  if  its  greatest  common  left  (right)  divisors  are  uni- 
modular  ma.tnces.  A  polynomial  matrix  is  called  unimodular,  if  its  inverse  is  also  a  polynomial 
matrix,  i.e.,  if  its  determinant  is  a  scalar  different  from  zero.  A  left  (right)  MFD  can  always  be 
transformed  in  a  coprime  left  (right)  MFD,  by  extracting  a  greatest  common  left  (right)  divisor. 
Furthermore,  two  coprime  left  (riglit)  MFD  of  the  same  system  differ  only  by  a  unimodular  left 
(right)  factor.  Finally,  if  Dl{s)]  and  {Nr{s),  Dr{s)]  are  coprime,  then  degdetDL(s) 

and  degdet  Dr[s)  are  minimum,  and 

deg  det /)£,(s)  =  deg  det  Dr{s)  =  n  —  order  ol  the  system 
Lemma  1.1  :  Invariance  of  row  and  column  degrees 

Let  {7V£,(.s),  Di,(s)}  be  a  coprime  left  MFD  wdth  Djr,(.s)  row  reduced  and  let  {Nr{s),  Dr{s)}  be 
a  coprime  right  MFD  with  Dr{s)  column  reduced,  tlien  the  row  degrees  of  are  invariant 

and  ec[ual,  except  for  possible  permutations,  to  the  oh serv ability  indices  {;/,}  ol  the  system. 
Similarly,  the  column  degrees  ol  D/j(s)  a.ie  mvaiiant  and  ecjual  to  the  couti  olluoility  indices 
{/i,}  of  the  system.  Also, 

■f)  J)  711  TU 

^  n.  =  n  =  ^  ^  dc-Dfi 

1  =  1  1=:1  t  =  l  1=1 

See,  e.(j,  Kailath  [51],  Chapter  6,  for  a  proof  of  this  result.  Note  that  there  is  an  infinite  number 
of  different  coprime  left  (right)  MFD’s  with  Dr{s)  row  reduced  {Dr{s)  column  reduced),  which 
differ  only  by  an  unimodular  left  (right)  factor. 


Definition  1.12  ;  Pseudo-canonical  left  and  right  MFD 


It  can  be  shown,  see  Correa  &  Glover  [52,  53]  and  Gevers  <V  Wertz  [54],  that  for  an}''  strictly 
proper  system,  and  for  any  valid  set  of  pseudo-observability  indices  {p,}  and  pseudo-controllabi¬ 
lity  indices  {s:,},  there  exist  a  unique  left  coprime  MFD  {Nl{.s),  Dr{s)]  called  pseudo- canonical 
left  MFD  and  a  unique  right  coprime  MFD  {Nr{s),  Dr{s)}  called  psi  lido-canonical  i  iyhi  MFD 
such  that: 


'  dc.Di  =  pi  Vz 

,  ^c[Dl]  =  I 

dviDi  <  max(p.,  -  1)  Vz 

,  diyNi  <  max(p.,  p,„ax- -  1)  Vz 


Oi'iDr 

z=z 

a.  V  z 

r,.[/>K] 

I 

Oc^Dr 

< 

max(a(, 

-  1)  Vz 

dc,NR 

< 

ma.x(K.i,  ZCmax 

-  1)  Vz 

25 


Furthermore,  it  can  be  shown  (see,  c.g.^  Correa  Glover  [52,  53])  that  the  pseudo-observability 
canonical  form  { Apoy,  C'poy}  is  the  observability  realization  (as  defined  in  Kailath  [51])  of 
the  pseudo-canonical  left  MFD  and  the  pseudo-controllability  canonical  form  { Ap^y,  Bpcy  j  Cpcy  } 
is  the  controllability  realization  of  the  pseudo-canonical  right  MFD.  Consequently, 


BlAs) 


pj-'^ 

-  ocijks’"  if  i  ^  j 

k~0 

Pi -I 

S^'  —  Y 

k=0 


Dr„U) 

Dr,M 


-  y  Sj.i-s''  if  1  r  i 

r-=o 


wliere  the  coefficients  ccijk  ^i^d  are  the  same  than  in  Definition  l.S  and  1.9.  Also, 


Pinax  1 

E  N,s' 

{i=u 


' 

■  0  ■ 

P.'n.ix  -1 

with  Y 

i-i) 

block  diag  < 

\ 

.  i 

0 

_  1  _ 

X 

11 

■■.V  ^ 

J 

Nn(s)=  E 

{=0 

with  Yl  block  diag  I  [O  •••  0  1  J  ,  (1  x  k,),  i  =  i, . . . ,  m  |  =  Cpcv 

i=0 

Definition  1.13  :  Canonical  left  and  right  MFD 

It  was  shown  by  Popov  [58],  Forney  [59],  Guidorzi  [60],  Beghelli  k  Guidorzi  [61]  and  Kailath  [51], 
that  for  any  strictly  proper  system  with  observability  indices  and  controllability  indices 
{/ij  there  exists  a  unique  coprime  left  MFD  {Nl{s),  Dl{s)}  and  a  unique  coprime  right  MFD 
{Nfi{s),  Dr{s)}  called  canonical  left,  echelon  form  and  canonical  right  echelon  form,  such  that: 


dc,Di  -  V,  \f  i 
Tc[Dl]  =  I 
di\Di  -  V,  V-i 

,  _  lower  triangular 

”  with  unit  diagonal 
,  dviNi  <  Vi  V'i 


dr,Dn  =  /q  V  v; 

TADr]  -  I 

dc,DR  =  //.,■  Vv: 

,  ,  _  upper  triangular 

~  with  unit  diagonal 
,  dciNn  <  fii  V  i 


(1.9) 


26 


The  observability  canonical  form  {Ao,j,  Boy,Coy}  is  the  observability  realization  (as  defined  m 
Kailath  [51])  of  the  canonical  left  MFD  and  the  controllability  canonical  form  {Acy,  Bcy,Ccy} 
is  the  controllability  realization  ot  the  canonical  right  MFD.  Consequently, 

i/j-i 

-  Y.  if  i^j 

k-O 

s"'  —  Y 

k=0 

-  Y  if  *  i 

k=0 

_  Y 

k=0 

where  the  coefficients  a.yt  and  ,Bijk  are  the  same  than  in  Definition  1.8  and  1.9  (some  coefficients 
a,ji,  and  0ijk  are  eciual  to  zero).  Also, 


Dl,{s)  = 
DU^)  = 

Dn,Y)  = 
DrY^)  = 


AT(-s)  =  Y 
»‘=0 


■  0  ■ 

\ 

,  (  i/j  X  i  )  ,  'li  1  5  •  •  ♦  )  P  ^ 

with  ^  Al^y  block  diag  < 

0 

T=:U 

_  1  . 

> 

^n(s)=  E 

1=0 

with  Y  ‘  ®  ^ 

t=0 


,  (i  X  a,'),  z  1, .  .  .  ,  itl  ^  ^cy 


The  pseudo-canonical  MFD  with  indices  identical  to  the  indices  ot  the  canonical  MFD  will,  ot 
course,  be  identical  to  the  canonical  MFD. 

It  should  be  pointed  out  that  the  canonical  Dnis)  is  always  row-reduced,  but  the  pseudo- 
canonical  Dl{s)  is  not  always  row-reduced.  Similarly,  the  canonical  Dr{s)  i.s  always  column- 
reduced,  but  the  pseudo-canonical  Dr{s)  is  not  always  column- reduced.  This  is  ot  some  im¬ 
portance  when  identifying  a  pseudo-canonical  left  or  right  MFD  since  the  constraints  (1.8)  c  o 
not  guarantee  that  the  estimated  transfer  function  matrix  is  strictly  proper  (see  Property  Li  . 

Finally,  it  is  interesting  to  note  that  the  uniciueness  of  Dl{-s),  and  consequently  ol  /\'l(-s)i 
only  depends  on  the  fact  that  its  leading  column  coefficient  matrix  is  the  identity.  Indeed, 
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suppose  there  existed  cinother  canoniccil  or  pseudo-ca,noniCcil  left  MFD,  ^  then 

there  would  exist  a  iinimodular  matrix  U{s)  such  that 


Dlis)  =  U{s)DM 

^  lim  (7(5)  =  iiT<i{Dl{s)S~^{s)){Di{s)S~^{s))~^  =  I 

s—*co  s~^co 

^  U{s)  =  I 

This  shows  how  the  uniqueness  of  a  left  MFD  is  related  to  the  knowledge  of  the  observability 
indices  or  of  a  set  of  pseudo-observability  indices  and  to  the  constraint  that  the  column  degrees 
(rather  than  the  row  degrees)  be  equal  to  them.  Similarly,  the  uniqueness  of  Dr{s),  and 
consequently  of  Nr{s),  only  depends  on  the  fact  that  its  leading  row  coefficient  matrix  is  the 

identity. 


In  the  case  of  the  system  given  as  example  in  Definition  1.6,  1.8,  a.nd  1.9 

i  -  -r  A-  —  2  *-  /  5  —  4 


P{s)  = 


^4-35^4-354-2  4-46"^  4-6524-5.6-4-2 

1  5^4-35^4-354-1 


5^  4-36-2  -j-3A4-2  5^  4-45-3  4-554-2 

the  observability  indices  are  {2.2},  the  pseudo-observability  indices  {2,2},  {3,1},  and  {1,3}, 
the  controllability  indices  {3,1},  and  the  pseudo-controllability  indices  {3,1}.  The  canonical 
left  MFD  (which  is  also  tlie  pseudo-ca.nonical  lett  Mb  D  with  indices  {2,2})  is  given  b\ 

.s  ~2.?  -  2 


Dd-^) 


+  2s  +  1 


=  I  =  I 


+  1  s~  -T  2.F  2 

The  pseudo-canonical  lett  MF'D  with  indices  {3,1}  is 

r^[Dd  =  i  d[DL]  = 


Ddd  = 


.P  -f  4s2  -f  4s  +  1  -2 

--  '  25  -L  1  .? 


1  0 
1  0 


^2  +  2.S  -  1  -2.5^  -  Is -3 
s  -2s  -  2 


AT(5)  = 

The  pseudo-canonical  lett  MFD  with  indices  {1,3}  is 


Ddd  = 


Ndd  = 


s  -f-  1  2s  -j-  2 

0  5^  -f  3.?^  -f  35  -b  2 

1  5  —  1 

1  5-  -b  25  -f  1 


rc[DL]  =  i  r,.[DL]  = 


0  1 
0  1 


The  canonical  right  MFD  (which  is  also  the  pseudo-canonical  right  MFD  with  indices  {3,1}) 
is  given  by 


Dr{s)  = 


-b  35^  -b  3.5  -b  2  1 


0 


-f  1 


r,.[Dfl]  =  I  FJDk]  =  I  Nr{s) 


P  +  s  -2 

1  1 
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Chapter  2 

Multivariable  adaptive  control 


2.0  Introduction 

In  this  work,  we  are  niostl,y  concerned  with  parametric  estimation  and  parametric  adaptive 
control  of  deterministic  continuous-time  linear  systems.  There  are  two  different  types  of  para¬ 
metric  adaptive  control  schemes:  direct  and  indirect.  Indirect  schemes  estimate  the  parameters 
of  the  transfer  function  of  the  process.  Then,  the  parameters  of  the  controller  are  updated 
based  on  these  estimates.  The  update  mechanism  of  the  controller  is  often  a  comple.x  nonlinear 
transformation  between  the  estimated  parameters  and  the  controller  parameters  which  depends 
on  the  techniciue  used  to  design  the  controller.  In  direct  adaptive  control,  the  parameters  of 
the  controller  are  estimated  directly.  This  is  often  possible  when  the  system  transfer  function 
ca.n  be  repa.rameterizcd  m  terms  of  the  regulator  pa.rameters.  In  tha.t  case,  the  estimator  up¬ 
dates  directly  the  regulator  parameters  and  the  adjustment  mechanism  between  the  estimated 
parameters  and  the  controller  parameters  is  simply  the  identity  transformation. 

The  main  direct  adaptive  control  schemes  for  continuous-time  linear  systems  are  the  di¬ 
rect  model  reference  adaptive  control  (MRAC)  scheme  and  the  direct  adaptive  pole  placement 
(PPAC)  scheme.  In  the  MR.AC  scheme,  the  desired  output  of  the  closed-loop  system  is  specified 
through  a  reference  model,  and  the  adaptive  controller  tries  to  make  the  plant  output  match  the 
reference  model  output.  There  exist  two  different  ways  to  implement  a  direct  MRAC  scheme. 
The  first  one  uses  for  identification  the  output  error  (the  difference  between  the  output  of  the 
plant  and  the  output  of  the  model)  and  assumes  that  the  reference  model  is  strictly  positive 
real  (SPR),  {cf.  Definition  1.5).  The  other  one  uses  the  input  error  (the  difference  between  the 
the  inverse  of  the  model  applied  to  the  output  of  the  plant  and  the  reference  input)  and  does 
not  require  such  assumption.  Another  advantage  of  input  error  schemes  is  the  fact  that  they 
can  be  used  in  conjunction  with  recursive  least-squares  parameter  estimation  algorithms,  while 
output  error  schemes  are  limited  to  gradient  type  algorithms  whose  convergence  is  very  slow 
when  there  is  a  large  number  of  parameters  to  estimate.  The  main  drawback  to  the  MRAC 
scheme  is  the  fact  that  it  is  applicable  only  to  minimum  phase  systems  (systems  whose  zeros  are 
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in  the  open  left-half  plane).  In  the  PPAC  scheme,  only  the  poles  of  the  closed-loop  system  are 
assigned  adaptively  to  predefined  locations.  The  PPAC  scheme  can  be  applied  to  minimum  and 
non-minimum  phase  systems.  As  opposed  to  direct  adaptive  control,  indirect  adaptive  contiol 
allows  for  the  use  of  almost  any  type  of  control  method  and  any  type  of  recursive  identifier.  On 
the  other  hand,  stability  may  be  difficult,  if  not  impossible,  to  guarantee.  In  this  chapter,  we 
present  continuous-time  direct  MRAC  and  PPAC  algorithms  and  also  a  recursive  identifier  that 
could  be  used  in  an  indirect  adaptive  control  scheme.  The  algorithms  presented  in  this  chapter 
are  similar  to  algorithms  that  are  found  in,  e.g.,  Elliot  k.  Wolovich  [6,  11],  Elliot  et  al.  [32],  and 
Das  [7].  After  some  preliminaries,  vv'e  first  show  how  to  define  a  model  refeience  controller  and 
a  pole  placement  controller  assuming  that  the  plant  is  known.  Then,  we  show  how  to  introduce 
parameter  estimation  and  adaptation  if  the  plant  is  unknown.  A  recursive  identifier  that  could 
be  used  in  an  indirect  scheme  is  also  presented.  Then,  we  give  the  available  stability  results  for 
the  two  direct  schemes  (MRAC  and  PPAC).  Finally,  a  comparison  is  made  between  schemes 
based  on  the  required  (i  priori  intormatioa. 


2.1  Preliminaries 

As  mentionned  in  Section  i.l,  P(-s)  denotes  the  transfer  function  of  a.  linear  time  invaiiant 
operator,  P.  Then,  P[u]  denotes  the  output  of  the  operator  in  the  time  domain  with  input 
v{t).  Furthermore,  the  dependency  in  .s  of  a  transfer  function  or  the  dependency  in  t  of  a  signal 
will  be  often  omitted  when  there  is  no  ambiguity. 

A  polynomial  in  s  is  called  rnonic  if  the  coefficient  of  the  highest  power  in  s  is  1  and 
Hurwitz  if  its  roots  lie  in  the  open  left-half  plane.  Rational  transfer  functions  are  called  stable 
if  their  denominator  polynomia.1  is  Huiavitz  and  viiutni'ii.ni  j)h(i.sc  if  their  numeiatoi  polynomial 
is  Hurwitz.  A  matrix  transfer  function  is  stable  if  all  its  elements  are  stable  and  is  minimum 
phase  if  its  inverse  is  stable. 

We  will  denote  by  i/,na.v'  the  maximum  of  the  observability  indices  {i/.}  {cf.  Definition  1.6). 
Similarly,  will  denote  the  maximum  of  the  controllability  indices  {/g}  {cf.  Definition  1.7). 
The  following  lemmas  will  be  useful  to  build  our  direct  multivariable  adaptive  controllers. 

Lemma  2.1  :  Bezout  identity 

Two  polynomial  matrices  N{s)  and  D{s)  are  left  copiime  iff: 

3  two  polynomial  matrices  U{s)  and  V(s)  such  that: 

N{s)U[s)  -r  D{s)V{s)  =  / 


and  right  coprime  iff: 

3  two  polynomial  matrices  U{s)  and  V^(s)  such  that: 
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U{s)N{s)  +  V{s)D{s)  =  I 


A  proof  can  be  found  in  Kailath  [51],  Chapter  6,  pp.  379. 

Lemma  2.2  :  Polynomial  matrix  division 

Let  A^k(s),A^l(s)  e  Dr{s)  e  Dl{s)  6  with  Dr{s)  and  Dl{s)  non¬ 
singular.  There  exist  unique  matrices  Qr{s),  Rr{s),  Ql{s),  B.l{s)  ,G  such  that; 

Nr{$)  =  Qr{s)Dr{s)  -1-  Rr{s)  and  Rr{s)Dr{s)-^  is  strictly  proper 

yV^(.s)  =  Dl{-s)Ql{-v)  Rl{-^)  and  is  strictly  proper 

We  will  call  Qr{s)  and  the  quotient,  and  Rr{.s)  and  Rl{s)  the  remainder,  of  the  matrix 

divisions  A^r(s)jD;^H-5)  and  DI^{s)Nl{s).  It  can  be  verified  using  Property  1.1  that 

dciRR  <  dciOR  and  drjii  <  OiiDi 

Furthermore,  if  D r{s)  is  column  reduced  and  Dl{s)  row  reduced,  there  exist  unique  matrices 
Qr{s).  Rr{s).  Ql{s),  Rl{s)  ,G  Tp-"[,s]  such  that: 

A'A('S)  =  Q r{''^) R r{-^)  T  Rr{^)  and  Oc^R-r  <  Oc^Dr 

=  Dl[s)Qr{s)  +  Rl{s)  and  dr.R-L  <  dr, Dr 

The  proof  of  this  lemma  is  in  Kailath  [51],  Chapter  6,  pp.  388-390. 


2.2  Control  algorithm 

2.2.1  Controller  structure 

The  following  controller  structure  is  considered  (see  Fig.  2.1) 

r  =  A'/o[co] 

u  =  C'o'r -f  A  ^C[u]-bA  ^  D[yp]  (2-1) 

wliere  u  is  the  vector  ol  inputs  of  the  S3^stem,  j/p  the  outputs,  /  the  leleience  signals,  Co  G 
is  nonsingular,  A(.s),  C(.s)  G  3?"‘>=’"[s],  C(s)  €  ^^‘"p]^],  and  Mo(.s)  €  ^ 

stable  transfer  function  matrix  and  A(s)  is  a  Hurvvitz  diagonal  matrix,  A(s)  =  diag{A.-(s)},  such 
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V 


Figure  2.1:  Controller  structure 

that  is  proper  and  is  strictly  proper.  It  is  sometimes  useful  to  rewrite  the  control 

law  (2.1)  as 

u=^r  +  A-^C[u]  +  i\-'D[v,]  (2.2) 

wliere 

=  6’f7^A"^D  proper 

A^^C  =  Cq  CV  ^ C  A-  [I  —  Cq  )  propel 

lim  A~^C  =  Co^.  =  (.^  “  C'o  ^) 

5 — ^CO 

However,  since  A^^C’  is  only  proper,  one  must  still  use  for  implementation  the  following  equiv- 
aleat  control  law 

U  =  (/  -  CoJ'^r  +  A-'(C  -  ACo^)[n]  +  A-'^[://,,])  (2-3) 

By  combining  the  equation  of  the  plant,  y,,  =  P[u],  with  the  equation  ot  the  controller  (2.1)  or 

(2.2),  the  output  j/p  can  be  expressed  as 

;Vp  =  Nn{{A-C)DR-DNRr^Aa>[r] 

=  iVH((A-C)r'R- .DiVfi)-'A[/  ]  (2.4) 

where  {Nr,  Dr}  is  a  right  MFD  of  P{s). 
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2.2.2  Model  reference 

Assumptions 

(Al)  Plant  assumptions 

The  plant  is  described  by  a  square,  nonsingular,  strictly  proper,  and  minimum  phase 
transfer  function  matrix  P(s)  G 

(A2)  Model  assumptions 

The  reference  model  M{s)  =  H{s)Mq{s),  where  H{s)  is  the  Hermite  normal  form  of  P{s) 
(see  Definition  1.4),  and  Mo{s)  G  is  a  proper  stable  transfer  function  matrix. 

(A3)  Reference  input  assumptions 

The  reference  input,  is  piecewise  continuous  and  belongs  to  t  >  Q. 

The.  model  outjnit,  is  defined  as: 

Y/,„  =  //iV/u['''o]  =  P[']  (2-5) 

Now,  we  show  that  there  exist  controller  parameters  va.lues  such  that  the  output  ot  the  plant 
y,,  matches  tire  out]:uil,  of  the  reference  model 

Proposition  2.1  :  Model  reference  matching  equality 

If  (9A;  =  //  -  1  and  ;/  >  then  there  exist  Q  G  C^{s),  D'{s)  G  solution  of 

the  Diophantinc  equation: 

Nr[{A  -  C^)Dr  -  D-An]“'ACj  =  H  (2.6) 

such  that  model  matching  is  achieved  (z. e.,  the  transfer  function  from  t  to  j/p  is  //(s)),  A 
is  proper,  and  is  strictly  proper.  In  particular,  (7q  =  Ap  ^  nonsingular,  dD  <  ^'inax  “  T 

and  dr, 6'*  <  dX:.  Similarly,  3(7*(5)  and  D*{s)  G  such  that  model  matching  is  achieved, 

A~'^D’  and  A^^C*  are  proper,  and  Cq^  =  /  —  Kp- 

Proof 

The  matching  ecjuality  (2.6)  is  ecpiivalent  to 

=  /  -  A-'C‘ -  A-^A’A  (2.7) 

Now,  let  {Ni,Dl}  be  a  left  coprime  MFD  of  P{s)  with  Dy  row  reduced  {‘()Di{s)  <  r'ma.x,  <^/- 
Lemma  1.1).  Using  the  polynomial  nratrix  division  (Lemma  2.2),  divide  AA  on  the  right 

by  Di,  then  3  Q{s),  A(.s)  G  such  that 

AK~^ =  QDr  +  P.  and  RDl^  is  strictly  proper 
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and  dciB.  <  dciDc  <  Then,  let 

D'  =  -r  =  qdl-  bk;^h-^  c*  =  k-qnl  Q  = 

It  can  be  easily  verified  that  the  given  Cj,  C‘,  D‘  solve  the  matching  equality  (2.7).  Further¬ 
more,  since  dX{  =  v  —  1,  A~^D*  is  proper.  On  the  other  hand, 

lim  =  lim  (/  -  K;^H-^P  -  A'^D^P)  =  7-7  =  0 

5— +00  6'— ►CJO  ^ 

so  that  A~^C‘"  is  strictly  proper  and  driC"  <  5A;  —  1,  e.g.,  driC"  <  r',„ax  —  2  if  dX{  =  t'max  —  1- 
Similarly,  dividing  A77~'  on  the  right  by  7)^,  then  3  Q{s),  R{s)  €  such  that 

AH^^=QDl  +  R.  and  RDl^  is  strictly  proper 


Let 


D-  =  QDl  -  AH-'  Cr  =  A-  QNl 

then  dD'  <  //.„ax  -  L  dr^C'  <  OX,,  =  7  -  77p,  and  the  given  C' 
the  matching  equality 

Nn[{A  -  C-)Dr  -  .D*A^fi]-'A  =  77 


and  D”  are  a  solution  ot 


□ 


Note  that  the  controller  parameters  Cj,  C",  and  77’  (or  C‘  and  D’)  are  not  uni(iuely  defined. 
We  will  show  in  the  next  chapter  (Chapter  3)  how  to  guarantee  uniqueness  of  the  controller 
parFiineters. 


2.2.3  Pole  placement 

Assumptions 

(Al)  Plant  assumptions 

The  plant  is  described  by  a  strictly  proper,  transfer  function  matrix  P{s)  G 


(A2)  Model  assumptions 

The  pole  placement  objective  is  equivalent  to  assuming  a  reference  model  A7(.s)  =  Afi(-s) 
77p'^(.s)  where  { A^/?(.s).  7)rf(.?)}  is  the  canonical  rig'ht  MFD  of  Pis)  (cf.  Definition  1.13). 
and  77m(-s)  =  diag{7,(.s)}  G  with  f7(.s)  monic,  Hurwitz,  and  dc!,{s)  =  /;,. 


(A3)  Reference  input  assumptions 

The  reference  input,  cu(/.),  is  piecewise  continuous  and  bounded  on  V  /  >  0. 
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The  model  output  is  defined  as 


2/m  =  NrD-^V]  (2.8) 

Similarly,  to  the  model  reference  case,  we  show  that  there  exist  controller  parameters  values 
such  that  2/p  matches  i/m- 

Proposition  2.2  ;  Pole  placement  matching  equality 

If  d\i  ^  1/  -  1  and  z/  >  G  9^mxm_  ^  D*{s)  €  solution  of  the 

Diophantine  equation: 

[(A  -  C')Dr  -  D-NrY^KC;  =  (2.9) 

such  that  model  matching  is  achieved,  A“^D*  is  proper,  and  A'^C*  is  strictly  proper.  In 
particular,  Cj  =  rc[Z)/?]  nonsingular,  dD"  <  —  I,  and  dviC’  <  Similarly,^3  6' 

G  and  G  such  that  model  matching  is  achieved,  A"^/)'  and  A“’C“  are 

proper,  and  =  I  - 

Proof 

The  proof  is  similar  to  the  model  reference  case.  The  matching  equality  (2.9)  is  equivalent  to 

CqDmDY  =  /  -  A-'6'-  -  k-^D'P  (2.10) 

Since  {Nr,  Dr]  arc  coprime,  by  the  Bezout  identity  (Lemma  2.1),  3  f/£  G  V[  G 

U^Nr  +  Vi,  Dr  =  I  UiP  +  14  =  DY 

Now',  let  [Nl,  Dr}  be  a  left  coprime  MFD  of  P{s)  with  Dr  row  reduced.  Using  the  polynomial 
matri.x  division  (Lemma  2.2),  divide  A1  c:[L)rj]Z)j\-/f/£  on  the  right  by  Dr,  then  3  Q{s)-,  P{s)  G 
^mxp[^^]  that 

Arc[DR]DMUl  =  QDr  +  R  and  RD^  is  strictly  proper 
and  dc,R  <  Oc^Dr  <  z/,.,ax.  Then,  let 

p*  =  =  QDr  -  AVcIDrIDmUI  C*  =  a  -  QNr  -  AT,[Dr]DmVr  C;  =  T,[Dr] 

It  is  easy  to  verify  that  the  given  Cq,  C",  D"  solve  the  matching  equality  (2.10).  Furthermore, 
since  9A,  >  n  -  1,  A“^T)*  is  proper.  On  the  other  hand 

lim  A-’C*  =  hm  (/  -  T,[Dr]Dm{UrP  +  Vr)  -  A-^ D^ P)  =  I  -  I  =  0 

S— +00  S—'CO 

so  that  A~^C*  is  strictly  proper  and  (9r,-6"  <  <9A,-  —  1. 

Similarly,  dividing  ADmUI  on  the  right  by  Dr,  then  3  Q{-s),  D{s)  G  such  that 

RDmUI  =  QDr  +  R.  and  RDY  is  strictly  proper 
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Let 


D-  =  QDl  -  kDMUl  C‘  =  A  -  QNl  -  ^DmVI 

then  db-  <  i/:nax  “  1,  dr^C*  <  d\i,  Co^  =  /-  Tc[Dr]-\  and  the  given  C*  and  D‘  are  a  solution 
of  the  matching  equality 

[iA-C*)Dn-D‘NR]-^K  =  Dj,^ 

□ 

Note  that  the  controller  parameters  Q,  C“,  and  D*  (or  C*  and  D*)  are  not  uniquely  defined. 
We  will  show  in  the  next  chapter  (Chapter  3)  how  to  guarantee  uniqueness  of  the  controller 
parameters. 


2.3  Adaptation 

In  order  to  implement  adaptation  in  the  model  reference  and  pole  placement  designs,  one  must 
estimate  C;,C‘,D‘,  (or  C%b'),  which  satisfy  the  matching  equality.  This  section  presents 
a  direct  MRAC  algorithm,  a  direct  adaptive  pole  placement  algorithm  and  also  a  recursive 
identifier  that  could  be  used  in  an  indirect  scheme. 


2.3.1  Model  reference  adaptive  control 

The  matching  equality  (2.6)  is  equivalent  to 

I  =  CoH~^P  +  A-^Cr  +  A-'D-P 

=  H-^P  +  A-^C’  +  A-^D^P  (2.11) 


Define  L{s)  =  diag{/(s)},  with  l{s)  Hurwitz,  dl{s)  >  d,  where  d  is  the  maximum  degree  of  all 
elements  of  =  {{s).  Then,  multiplying  both  sides  of  (2.11)  by  and  applying  both 

transfer  function  matrices  to  u  leads  to 


L-^[a]  =  Co(i/r)-M''/p]  +  L-bA-^C-[xi]  +  A-'D*[yp])  (2.12) 


If  H{s)  is  known  a  priori,  then  (2.12)  is  an  equation  where  the  unknown  parameters  appear 
linearly.  Indeed,  given  Proposition  2.1,  there  exist  matrices  Cf , .  . . ,  ,  D-^, . . . ,  ' 

such  that 


A-'C*  = 


A-'D*  = 


EC- 


DI  +  Y.D] 


W) 
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The  matrix  of  unknown  controller  parameters  is 


e 


and  the  regressor  vector 


0 


T 


(2.13) 


so  that  (2.12)  can  be  rewritten  as 

L-^[u]  =  0*'"xl^  (2.14) 

Then  the  following  error  equation  can  be  derived 

C2  =  6'''V'  -  L-^W]  =  (0'^'  -  (2-15) 

where  0  is  the  estimate  of  0’  and  4>  is  the  parameter  error.  At  this  point,  0  ma}'  be  estimated 
using  a  standard  linear  estimation  algorithm.  We  will  consider  the  normalized  least-squares 
algorithm  with  covariance  resetting  (see  section  2.4). 

The  error  equation  is  equivalent  to  the  one  presented  in  Elliot  iz  Wolovich  [6,  11]  and 
included  in  Sastry  k  ITxlsoii  [3].  It  requires  the  a  priori  knowledge  of  the  Ilerniite  normal  form 
H{s)  and  an  upper  bound  i/  on  the  observability  index  Then,  the  number  of  parameters 

to  identify,  Ng,  is 


2.3.2  Extended  model  reference  adaptive  control 

If  the  normal  Hermite  form  is  not  known,  but  the  coefficients  {r.}  are,  it  is  still  possible  to 
identify  the  controller  parameters.  Using  the  parameters  C*,  D%  the  matching  equality  (2.6)  is 
equivalent  to 

I=H-^P  +  A-^C‘  +  A-^D*P  (2.16) 

Then,  using  the  properties  of  H~'^{s)  (see  Definition  1.4)  and  applying  the  transfer  function 
matrices  to  u  leads  to 

L-^[u]  -  L-^A[y,]  =  L-\E'FA[y,]  +  4-  A-'D*[y/,])  (2.17) 

where  L~^  is  as  previously  defined.  By  defining  0'  and  4’  accordingly,  this  is  ecjuivalent  to 

(2.18) 

so  that  standard  linear  estimation  techniques  can  again  be  used. 

This  algorithm  is  essentially  the  one  presented  in  Das  [7]  and  Dion  ei  al.  [50].  In  this 
algorithm,  the  number  of  parameters  Ng  >  'IjAiy. 
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2.3.3  Adaptive  pole  placement 

The  matching  equality  (2.9)  is  equivalent  to 

/  =  QDmD:^^ +A-^C* +  A-^D*P 

=  DmD;^^  +A-^C*  +  A-^D*P  (2.19) 

Unfortunately,  Dr  being  unknown,  the  previous  scheme  cannot  be  directly  used.  However,  since 
{Nr,  Dr}  is  coprime,  by  the  Bezout  identity  (Lemma  2.1),  3  t/£  G  V£  G  such 

that 

V£Dr  +  UINr  —  I  I'L  "b  PrP  =  Dff^  (2.20) 

Note  that  {/£  and  V£  are  generally  not  unique.  It  can  also  be  shown  that  there  exist  Uj^  and 
V£  such  that  dUl  <  i/,„ax  “  1  dV£  <  dUl- 

Proposition.  2.3  :  Degree  of  the  elements  of  the  Bezout  identity 

Given  a  right  coprime  MFD  [Nr,  Dr},  3  matrices  f/£  G  Vj]  G  such  that 

V£Dr  +  UrNr  =  I  and  <  'Auax  ^  1 


Furthermore,  5F£  <  5f/£. 


Proof 

Since  [Nr,  Dr}  are  coprime,  we  know  by  the  Bezout  identity  (Lemma  2.1)  that  there  exists  a 
solution  Or  G  Vr  G  such  that 

VrDr  +  UrAr  =  I 


Divide  Ur  on  the  right  by  Dr,  where  {AT,  Dr}  is  a  left  MFD  with  Dr  row  reduced  {ODr  <  n,„ax, 
cf.  Lemma  1.1),  then  by  the  polynomial  matrix  division  (Lemma  2.2)  3  Qr  and  f/£  G 
such  that 


Ur  =  QrDr  +  £/£  and  D£D^^  is  strictly  proper 


and  dUl  <  n,„ax  ~  1-  Now  let 


Vr  =Vl  +  QlNr 

It  can  be  easily  verified  that  {/£,  V£  is  also  a  solution  of  the  Bezout  identity.  Furthermore,  from 
(2.20),  we  have  that 

r;  =  D-^'  -  uiP 


with  P  strictly  proper,  so  that  d\ r  <  SUr  (he.,  d\ r  n,„ax  2  il  dc,bR  R:  /n, 


!)• 


Now,  define  L{s)  =  diag{/(s)},  with  l{s)  Hurwitz,  dl{s)  —  u  —  I,  and  n  >  i/,„ax-  Then  us¬ 
ing  (2.20),  multiplying  both  sides  of  (2.19)  by  {DmL)-\  and  applying  both  transfer  function 
matrices  to  u,  leads  to 

{DmP)~^[u]  =  L~^{{ADm)~^C*[u]  +  (AD,v/)“^i)'[?/p]  +  Vr[h]  +  Ul[yp])  (2.21) 
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This  is  an  equation  where  the  unknown  parameters  appear  linearly.  However,  to  achieve  the 
pole  placement  objective,  we  must  guarantee  that,  for  all  inputs  u,  equation  (2.21)  has  a  solution 
which  is  also  the  solution  of  the  pole  placement  matching  equality  (2.19)  and  the  Bezout  identity 
(2.20). 

Proposition  2.4  :  Equivalence  of  (2.21)  with  (2.19)  and  (2.20) 

If 

dXi  —  Prcia-x  /^i  d"  ^  1 

then  there  exists  a  solution  C\  D"  of  the  matching  equality  (2.19)  such  that 


dciD‘ 

< 

^inax 

-  1  <  1/  -  1 

dfrC" 

< 

/^'inax 

—  +  //  —  1 

dc,6'“ 

< 

/^'luax 

-  /i,-  +  -  2 

C‘ 

COjj 

— 

(/- 

rcM-^)p  =  o  if  i>j 

(2.22) 

Furthermore,  under  these  constraints,  any  solution  of  (2.21)  valid  for  all  u  is  also  a  solution  ot 
(2.19)  and  (2.20). 

Proof 

From  Proposition  2.2,  we  know  that  there  exists  a  solution  C*,D"  to  the  matching  equality 
(2.19)  such  that 

(9c, 0“  <  -  1  <  n  -  1 

di',C'  <  d\i 

lim  A-'C*  =  Q,  =  I-  Co^.  =  0  if  i  >  J 

5 — ^CO  ^  ‘J 

If5A;  =:  /Wx  - -  1  then  dr\C*  <  /ii  + u -1.  Furthermore,  dri{ADM)  =  /'ma.N  +  J' -  1 

and  D*Nr  is  strictly  proper.  Consequently,  using  (2.19) 

lim(AZ)M)~'C*Z9fi  =  \\m[DjlDR  -I-  {ADm)~^D*Nr]  =  1-1  =  0 

5— *-00  6-  — CO 

So  that  {ADm)~^C‘ Dr  is  strictly  proper  and  dciC'  <  —  //.,  +  /^  —  2. 

Finally,  if  equation  (2.21)  must  be  verified  V  u. 

[DmL)-^  -  L-^{{AD,r)-^Cr  +  {ADm)-^D^P  +  Vi  +  [/£P) 


or  equivalently 


wliich  is  strictly  proper  on  one  side  and  polynomial  on  the  other,  so  that  both  sides  must  be 
identically  zero,  or  equivalently 


I  =  +  A-^D'P 

1  =  v^Nr  +  uiDr 

Therefore,  a  solution  of  (2.21)  for  all  inputs  u  is  also  a  solution  of  (2.19)  and  (2.20). 


Now,  let  us  assume,  for  simplicity,  that  {A;(s)}  and  {d;(s)}  are  such  that  A.-(s)d,(s)  —  7(5)  Vh 
Then  r(s)  =  diag{7(s)}  is  stable  with  d-y{s)  =  pmax  +  -  1-  Based  on  Propositions  2.2,  2.3, 

and  2.4,  we  can  define  matrices  Q, .  .  . ,  ■  ■  ■  i  ■  ■  ■  ■>  K-i ;  j 

G  such  that 


(rL)-'C” 


{VL)-^D- 

L-^Vi 

L-^Ul 


y  c*— — 

k  'y)7(-o 

EK- 

1=1 


E'fA; 


/(s) 

~W) 


Note  that,  given  the  conditions  (2.22)  on  C*,  the  matrices  C'  with  i  >  [u  —  1)  contain  several 
elements  equal  to  zero.  The  matrix  of  unknown  controller  parameters  is 


d:  v{ 


V. 


U{ 


u: 


and  the  regressor  vector 


•0^ 


(r/-)“^['(E  ■■■  sf''"'"''''"'"'*'''  ^'(rr)  ^[uj^  (rr)  ... 

(2.23) 


.so  th.at  (2.21)  caa  be  rewritten  as 


(2.21) 


and  an  error  equation  can  be  derived 

62  =  O'^Tp  -  L~^DpJ{ji)  =  (y  -  (2.25) 
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where  6  is  the  estimate  of  6*  and  may  be  estimated  using  a  standard  linear  estimation  algorithm. 
Note  that,  with  the  conditions  (2.22),  {I  -  CqJ)  is  upper  triangular  with  one’s  on  the  diagonal 
and  is  guaranteed  to  remain  nonsingular.  Furthermore,  since  {I  —  is  an  upper  triangular 

matrix,  it  can  be  easily  inverted. 

The  pole  placement  algorithm  requires  the  a  priori  knowledge  of  the  controllability  indices 
{/q}  and  an  upper  bound  u  on  the  observability  index  The  riumber  of  parameters  to 

identify,  Ng,  is 

-  1)  +  2mpi/  <  Ng  <  2m?[u  -  1)  +  2mpi/  +  Tn(m/q„ax  —  n) 

This  algorithm  is  similar  to  the  one  presented  in  Elliot  et  al.  [32].  However,  their  algorithm 
does  not  match  a  fixed  model  but  a  member  of  the  class  of  models  NrUDj}  where 

U{s)  is  an  unimodular  polynomial  matrix. 


2.3.4  Recursive  identification 

A  recursive  identifier  is  reviewed  here.  Such  an  identifier  coidd  be  used  in  an  indirect  adaptive 
control  scheme.  Assume  that  Dr]  is  a  left  MFD  of  a  strictly  proper  transfer  matrix,  P{s) 
G  with  Dr  row  reduced,  and  A(.s)  =  diag{A,(.s)},  with  d\i  =  >  /-"ni.-ix-  Then 

i\-\Dr  =  i\~^DlP  (2.26) 


.Applying  (2.26)  to  it.  leads  to 

=  A-F\TM-A-^(i}z.-A)[?A]  (2.27) 

which  is  an  equation  where  the  unknown  parameters  appear  linearly.  By  properly  defining  &' 
the  matrix  of  unknown  parameters  and  '</'  the  regressor  vector,  a  linear  error  equation  can  be 
derived 

62  =  -  ijj,  =  {0^  -  6''^)ip  =  (jy^ i>  (2.28) 

The  minimum  necessary  a  prion,  information  is  z/  >  Indeed,  if  only  ;/  is  known,  there  exists 

a  possibly  noncoprime  left  MFD,  {AT,  Dr}  such  that  ONr  <  n  —  1  and  d{DR  —  L)  <  —  I,  (see 

Elliot  &  Wolovich  [11])-  ConsequentTg  the  number  of  parameters  to  identify,  Ng  =  p{p  +  m)i/. 
Note  that  {Nr,  Dr}  is  generally  not  unique. 


2.4  Parameter  estimation  algorithm 


We  will  assume  that  the  following  normalized  lea,st-squares  identification  algorithm  with  co- 
variance  resetting  is  used; 


P'lpeJ 

1  + 


with  y,7>0 
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P  =  vvith  P(0)  =  P(r,)  =  ^'0/ >  0  (2.29) 

1  +  7^-'  V 

where  62  is  the  identifier  error  (2.15)  and  {T;t}  c'-re  the  resetting  time  instants  such  that 

{Tk}  =  {TklKnUPin  -  <^rj)  =  ^7  with  0<h<  ko  and  0  <  (5,,  <  ^-2} 

where  A^ax  denotes  the  largest  eigenvalue.  The  matrix  P  is  discontinuous  at  the  resetting 
instants  Tk,  with  the  limit  on  the  right  P{Tk)  equal  to  a  predetermined  matrix  kol.  A  degree 
of  freedom  has  been  left  in  the  definition  of  the  resetting  instants.  Resetting  occurs  within 
a  fixed  period  of  time  k2  after  A,.,ax(R(0)  has  reached  a  certain  minimum  level  k^,  but  the 
specific  time  instant  is  left  free  at  this  stage.  The  time  dela^^s  Sr,,  are  introduced  to  account 
for  the  fact  that  A.„ax(T’(0)  onl.y  be  computed  at  discrete  time  intervals.  If  k^  -  0,  the 
standard  least-squares  algorithm  without  resetting  is  obtained.  For  k\  >  0,  the.  algorithm  will 
reset  whenever  the  P  matrix  becomes  too  small. 


The  following  definitions  are  needed  belore  stating  the  properties  ot  the  estimation  algo¬ 
rithm. 

Definition  2.1  ;  Persistent  Excitation 

A  bounded  vector  ‘th  is  persistciitly  exciting  (PE)  ift 

3o:>0  3(i>0  such  that  /  '  Ei/'^  E  V  /q  ^  0 

Jto 

Definition  2.2  ;  Sufficient  Excitation 
A  bounded  vector  iIj  is  sufficiently  exciting  (SE)  iff 

3  a  >  0  such  that  V  to  >  0  3  ^ (to)  >  0  such  that  /  dr  >  al 


Note  that  if  a  signal  is  PE  then  it  is  also  SE,  but  the.  converse  is  not  true. 


Lemma  2.3  :  Properties  of  the  estimation  algorithm 

Assuming  that  E  €  Tooe,  the  estimation  algorithm  (2.29)  has  the  following  properties 


L  0  P  ^  /vq/,  u  ^  ^  ^  ^  ^ 


and 


Pt/. 


(n 


/,)l/2  1 


a, 


PO 


1 


Eco. 


2.  (Tfc.^_i  —  Tk)  is  bounded  below  V  k. 
(l  +  -y^Tpi/2  ,  d  /^  =  TPPTT  ^ 

172)  ^  ^2- 


{l+^4,Tpl/2 
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5-  If  is  not  SE  or  if  =  0  (no  resettings): 

•  {r;t}  is  a  finite  set. 

•  P'P  p  -rr  =  fii —  G  Lo. 

•  E  G  El- 

•  E(t)  and  ^(t)  converge  to  some  P^o  and  <f>oo- 


6.  If 


_ V' 


is  SE: 


•  linii^co  <?^(0  =  0. 


7.  If 


_ 


is  PE  and  ki  >  0: 


•  limt_co  4>P)  =  0  exponentiall3C 


8.  ’'f  f  >  0=  where  p,  is  the  i-th  column  of  <p. 

The  proof  is  in  the  appendix. 


Comments: 

The  specific  adaptation  algorithm  is  chosen  for  its  special  properties  given  in  Lemma  2.3. 
Most  important  is  the  fact  that  the  parameter  error  (}>  converge.s  (although  not  necessarifi^  to 
zero)  independent  ot  richness  properties  ot  'ip.  It  ma^^  converge  to  zero  or  to  some  other  value. 
.Also,  if  p  is  not  SE  or  if  k^  =  0  (no  resettings)  Pp  will  have  the  same  properties  as  and 
there  will  be  a  finite  number  ot  resettings.  These  properties  result  from  the  use  of  A  max  (m) 
for  the  resetting  instead  of  A,n;i,(E(t))  as  in  Sastry  &  Bodson  [3].  When  there  is  not  sufficient 
excitation,  the  algorithm  will  not  reset  the  covariance  after  some  time  and  the  algorithm  has 
the  same  properties  as  when  covariance  resetting  is  not  used.  Finally,  it  should  be  noted 
that  the  exponential  convergence  under  PE  conditions  is  guaranteed  (rather  than  asymptotic 
convergence)  when  the  covariance  resetting  is  used.  However,  the  stability  results  will  be  valid 
whether  the  resetting  is  used  or  not  and  whether  there  is  excitation  or  not. 


2.5  Stability 

2.5.1  Stability  of  the  direct  MRAC  algorithm 

Stability  proofs  for  MIMO  systems  follow  similar  paths  as  for  SISO  systems.  Difficulties  arise, 
mainly  because  of  singularities  that  are  encountered,  such  as  when  the  matrix  Co  is  singular 
ill  the  MRAC  algorithm.  These  problems  are  also  present  in  the  SISO  case,  but  become  more 
complex  in  MIMO  systems. 
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Consider  the  problem  of  singularity  of  Co  in  the  MRAC  algorithm.  Attempts  to  prove  the 
global  stability  of  the  algorithm  reveal  that  the  inverse  of  the  matrix  used  by  the  controller 
must  be  bounded.  This  boundedness  is  not  guaranteed  by  the  adaptation  algorithm  described 
in  the  previous  section  so  that  the  adaptive  control  scheme  must  be  modified  when  the  estimate 
of  Co  comes  too  close  to  singularity.  There  has  been  a  significant  research  effort  to  resolve  this 
problem  in  the  SISO  case  and  several  solutions  have  been  proposed.  Their  extension  to  MIMO 
systems  is  far  from  trivial  however.  A  New  MIMO  parameter  transformation  is  presented 
in  Chapter  4  which  allows  the  controller  parameter  of  a  MRAC  scheme  to  stay  away  from 
singularity.  In  this  chapter,  however,  we  will  rely  on  stability  results  that  are  based  on  rather 
restrictive  assumptions,  but  are  easily  derived  from  the  current  literature. 

Before  stating  any  stability  results,  the  following  definitions  are  needed.  Since  the  regressor 
vector '0  is  made  of  filtered  input  and  output  signals,  define  the  transfer  function  matrix, 
as  the  transfer  function  between  ip  and  u.  We  also  define  the  model  s^ujnals  ip,„  as  the  signals  i> 
when  the  parameter  error  p  =  0  (model  matching  is  achieved) 

■iP,n  =  (2.30) 

It  can  be  verified  that  is  stable  and  strictly  proper,  since  R(.s)  is  minimum  phase. 

Finally,  define  the  regrea^or  error  as 

=  'Ip  —  'tp,,^ 

and  the  output  error  as 

^0  ^ 

Given  these  definitions,  the  following  stability  results  can  be  proved: 

Theorem  2.1  :  Global  stability  of  the  direct  MRAC  algorithm  -  A'p  known 
Consider  the  MIMO  MRAC  system  described  in  Section  2.3.1.  A.s.sume  that  the  high-frequency 
gain  matrix  =  C'j”'  is  known,  so  that  the  control  parameter  matrix  Co  does  not  need  to 
be  estimated.  Assume  that  the  recursive  least-squares  algorithm  (2.20)  is  used  for  parameter 
identification.  If  the  reference  input  r  £  Loo  and  is  piecewise  continuous,  then 

1.  all  the  states  of  the  adaptive  control  system  are  bounded. 

2.  the  regressor  error  e,/,  €  T2  0  Too  and  limi_+oo  =  0. 

3.  the  output  error  eo  G  Loo  and  limj^co  =  0. 

The  proof  of  this  theorem  is  a  relatively  straightforward  MIMO  extension  of  the  SISO  proof  in 
Sastry  &  Bodson  [3]  and  is  omitted  here.  Requiring  the.  a  priori  knowledge  of  the  high-frequency 
gain  matrix  Kp  is  not  very  practical  however.  A  slightly  less  restrictive  solution  is  proposed 
in  Singh  k  Narendra  [9]  and  Tao  k  loannou  [8],  which  a.ssume  tha.t  a  matrix  S  such  that 
SKp  -f  {SKpY  >  0  is  known.  In  the  SISO  case,  this  is  equivalent  to  assuming  the  knowledge 
of  the  sign  of  the  high-frequency  gain.  Assuming  a  less  restrictive  type  of  prior  knowledge,  the 
following  stability  result  can  also  be  proved; 
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Tlieorem  2.2  ;  Local  stability  of  the  direct  h/IRAC  algorithm  -  Ap  unknown 
Consider  the  MIMO  MRAC  system  described  in  Section  2.3.1.  Assume  that  the  columns  of 
the  initial  parameter  error,  ^,-(0),  are  sufficiently  small  that,  for  all  vectors  <f){  such  that 
<  II  ^,(0)11,  Co  is  nonsingular.  Assume  that  the  recursive  least-squares  algorithm  (2.29)  is  used 
for  parameter  identification.  If  the  reference  input  r  €  Loo  and  is  piecewise  continuous,  then 

1.  all  the  states  of  the  adaptive  control  system  are  bounded. 

2.  the  regressor  error  e,/,  G  A2  H  Loo  s.nd  limi^oo  =  0. 

3.  the  output  error  cq  G  Loo  s-^d  lim/_co  cq  =  0. 

Given  the  convergence  properties  of  the  least-sciuares  estimation  algorithm  (see  Lemma  2.3), 
ll</>.(011  ^  ll<?^i(0)ll  Vt  >  0.  Therefore,  if  the  initial  parameter  error  i.s  “sufficiently  small”,  Co{t) 
will  remain  nonsingular  V  i  >  0.  Again,  the  proof  is  a.  direct  extension  of  the  proof  in  the  SISO 
case  and  is  omitted  here. 

The  condition  on  4>{0)  requires  a  strong  ft  prion  information.  This  condition  is  necessary  to 
avoid  singularity  regions.  It  will  be  shown  in  Chapter  4  how  this  coirditioir  can  be  relaxed. 

2.5.2  Stability  of  the  direct  PPAC  algorithm 

Similarly  to  the  MRAC  algorithm,  the  regressor  vector  is  made  of  filtered  input  and  output 
signals,  so  that  a  transfer  function  matrix  H^n.is)  between  -0  and  u  can  be.  defined.  Similarly, 
the  model  signals  'i/),,,  are  defined  as  the  signals  C  when  (l>  —  0 

ijj.a  =  H^uDrD^JIt]  =  (2.31) 

A  proof  of  the  global  stability  and  convergence  of  the  error  signals  eo  and  to  zero  is  currently 
not  available  without  input  conditions  for  the  PPAC  algorithm.  At  the  price  of  some  additional 
prior  information,  the  following  result  can  be  proved: 

Theorem  2.3  :  Local  stability  of  the  direct  PPAC  algorithm 

Consider  the  MIMO  PPAC  system  described  in  Section  2.3.3.  Assume  that  the  columns  of  the 
initial  parameter  error,  (f>i{0),  are  sufficiently  small  that,  for  a.ll  vectors  (j)i  such  that  j|<^t||  ^ 
||<^i(0)||,  the  closed-loop  poles  of  the  system  are  stable.  Assume  that  the  recursive  least-squares 
algorithm  (2.29)  is  used  for  parameter  identification.  If  the  reference  input  r  G  Loo  and  is 
piecewise  continuous,  then 

1.  all  the  states  of  the  adaptive  control  system  are.  bounded. 

2.  the  regressor  error  G  Loo- 

3.  the  output  error  Cy  G  Loo. 
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The  proof  is  in  the  appendix. 

Again,  the  condition  on  (f){0)  requires  a  strong  a  priori  information.  This  condition  is 
necessary  to  avoid  singularity  regions.  Unfortunately,  it  is  still  very  much  an  open  problem.  It 
might  be  noted  that  some  stronger  results  are  available.  In  the  SISO  case,  it  is  proved  in  Elliot 
et  al.  [62]  that,  if  the  regressor  vector  tp  is  persistently  exciting  (PE),  then  all  states  remain 
bounded.  Furthermore,  eo  and  e^p  will  converge  to  zero.  However,  the  proof  assumes  that  the 
controller  parameters  are  updated  at  discrete  time  instants.  A  similar  result  is  obtained  by 
Willner  et  al.  [34]  for  a  discrete  time  MIMO  algorithm.  For  a  discrete  time  SISO  algorithm 
using  a  different  setting,  it  is  showed  in  Kamen  [63]  that,  if  the  input  is  sufficiently  exciting,  then 
the  parameter  estimates  0  will  converge  “sufficiently  close”  to  their  true  values  O',  so  that  all 
states  remain  bounded.  Finally,  complex  modifications  are  proposed  in  Janecki  [64]  to  guarantee 
global  stability  without  input  conditions  for  a  discrete  time  SISO  algorithm.  Unfortunately,  an 
auxiliary  estimation  algorithm  must  be  introduced  lor  the  implementation. 


2.6  Comparison 

This  section  makes  a  general  comparison  ol  the  algorithms  presented  in  this  chapter  in  terms  ol 
necessary  a  priori  information  and  number  of  parameters  to  identify.  Table  2.1  summarizes  the 
previous  results  concerning  the  a  prion  iniormation  and  the  number  ol  adaptive  paiameteis 
required  by  the  different  algorithms.  Only  the  a  priori  information  relevant  to  the  paramctcr- 


Algorithm 

A  priori  information  N$ 

Direct  MRAC 

~  ^laax 

2p^U 

Extended  MRAC 

>  '2p^u 

Direct  PPAC 

i 

{/^•i  }  5  ^  ^  ^luax 

<  2rn\u  -  1)  +  2mpu  -F  -  n) 

>  2'nP{i-'  —  1)  +  2rnpu 

Recursive  identification  i 

p{p  -f  Tn)i/ 

Table  2.1:  A  priori  information  and  number  of  parameters 


ization  is  shown  in  Table  2.1.  In  other  words,  this  is  the  information  needed  to  defined  the 
structure  of  the  controller,  including  the  number  of  its  parameters.  Other  assumptions  may  be 
needed  for  stability  considerations.  For  example,  a  MRAC  algorithm  requires  minimum  phase 
assumptions  that  are  not  needed  for  PPAC.  Other  assumptions,  such  as  those  necessary  to 
guarantee  that  is  bounded  may  also  be  needed.  These  assumptions  are  summarized  in  Ta¬ 
ble  2.2.  Note  that  a  complete  and  correct  proof  of  stability  for  the  extended  MRAC  algorithm 
does  not  exists  in  the  literature.  Theretore,  at  this  stage,  only  local  stability  will  be  assumed. 
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Algorithm 

A  priori  information 

Stability  result 

Direct  MRAC 

Minimum  phase,  ^(0)  sufficiently  small 

Local  stability 

Direct  MRAC 

Minimum  phase,  Ap 

Global  stability 

Exteirded  MRAC 

Minimum  phase,  ^(0)  sufficiently  small 

Local  stability 

Direct  PPAC 

^(0)  sufficiently  small  1 

Local  sta))ility 

Ta.ble  2.2;  .4  priori  information  and  sta.bility 
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Chapter  3 

Parameter  convergence 


3.0  Introduction 

Several  MIMO  MRAC  algorithms  have  been  proposed  in  the  literature,  cjj.,  Goodwin  k  Long 
[20],  Elliot  k.  Wolovich  [6,  11],  Singh  k  Narendra  [9,  10],  Dugard  ej.  al.  [12],  Johansson  [13], 
Ortega  et  al.  [14],  Das  [7],  Dion  et  al.  [50],  and  Tao  k  loannou  [S].  The  direct  pole  placement 
approach  was  investigated  by  Elliot  et  al.  [32],  Djaferis  et  al.  [33],  and  Elliot  k  Wolovich  [11]. 

The  emphasis  of  these  papers  has  been  on  finding  parameterizations  for  the  controllers,  (a 
problem  much  more  complex  for  multivariable  s3^stems  than  for  SISO  systems),  proving  stability 
(in  a  few  cases),  and  trying  to  extend  the  schemes  in  ways  to  reduce  the  amount  of  a  pnnn 
information  required.  Close  inspection  reveals  that  parameter  convergence  is  not  guaranteed  for 
these  schemes,  even  with  rich  input  signals,  because  they  rely  on  parameterizations  that  do  not 
define  the  parameters  uniquely  (in  the  previous  chapter  (Chapter  2),  the  controller  parairreteis 
were  not  uniquely  defined).  A  parameterization  that  defines  the  controller  parameters  uniquely 
will  be  called  identifiable.  The  parameterizations  presented  in  the  previous  chapter  (Chapter 
2)  were  not  identifiable,  since  &*  was  not  uniquely  defined.  When  the  parameterization  is  not 
identifiable,  the  estimate  of  the  parameters  0  cannot  converge  to  a  unique  value.  Instead,  0 
converges  into  a  set.  Therefore,  parameter  convergence  cannot  be  guaranteed,  even  with  rich 
input  signals. 

In  this  chapter,  we  show  how  to  modify  current  continuous-time  direct  MRAC  and  PPAC 
algorithms  and  a  recursive  identifier,  to  guarantee  identifiability.  In  other  words,  we  present 
direct  MRAC  and  PPAC  algorithms  and  a  recursive  identifier,  using  parameterizations  for 
which  the  parameters  are  uniquely  defined.  We  extend  the  work  of  Willner  et  al.  [34]  which 
considered  the  problem  for  a  discrete-time  adaptive  pole  placement  algoiithm. 

Parameter  convergence  is  important  for  robustness  to  noise  and  unmodeled  dynamics  (c/. 
Sastry  k  Bodson  [3]).  At  the  end  of  this  chapter,  an  example  illustrates  this  fact  by  showing- 
two  MRAC  algorithms  (one  with  an  identifiable  parameterization  and  the  other  with  a  non- 
identifiable  parameterization)  applied  to  a  system  with  noise  and  unmodeled  dynamics.  Only 
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the  scheme  based  on  the  identifiable  parameterization  remained  stable. 

In  this  chapter,  we  also  derive  simple  frequency  domain  conditions  on  the  inputs  that  guar¬ 
antee  parameter  convergence  to  the  nominal  values  for  the  adaptive  control  schemes  presented 
in  the  previous  chapter  (Chapter  2).  Similar  conditions  were  obtained,  using  generalized  har¬ 
monic  analysis,  in  multivariable  recursive  identification  by  de  Mathelin  &  Bodson  [65],  and  in 
SISO  adaptive  control  by  Boyd  &  Sastry  [66].  However,  the  conditions  in  multivariable  adaptive 
control  are  not  trivial  extensions  of  the  conditions  in  the  SISO  case.  An  important  difference 
with  the  SISO  case  is  that  the  necessary  and  the  sufficient  conditions  for  parameter  convergence 
may  be  different.  Indeed,  parameter  convergence  may  depend  on  the  location  of  the  spectral 
components  of  the  inputs.  For  the  same  number  of  frequencies  in  the  inputs,  convergence  may 
depend  on  the  locations  of  these  frequencies.  This  is  not  the  case  with  SISO  systems  where 
only  the  number  of  frequencies  is  relevant  (c/.  Boyd  &  Sastry  [66]).  Note  that  a  summary  of 

these  results  was  presented  in  de  Mathelin  fc  Bodson  [67]. 

On  the  basis  of  the  results,  the  adaptive  schemes  and  a  recursive  identification  scheme  are 
compared  with  respect  to  the  requirements  for  parameter  convergence.  We  note  that  although 
the  parameterizations  under  consideration  are  all  identifiable,  they  have  different  numbers  of 
parameters  and  require,  different  conditions  for  parameter  convergence.  We  present  specific 
examples  illustrating  these  differences  and  show  cases  where  an  indirect  scheme  conveiges,  al- 
though  the  direct  scheme  does  not,  and  vice  versa.  This  shows  that  the  so-called  equivalence 
between  direct  and  indirect  schemes  is  not  as  obvious  as  it  appears  from  the  SISO  case.  De¬ 
pending  on  the  application  under  consideration,  the  designer  may  find  advantages  to  direct 
ns  indirect  approaches.  In  some  cases,  the  computations  required  by  a  direct  scheme  may  be 
significantly  less  than  for  an  indirect  scheme.  The  reverse  may  also  be  true  and  a  decision  must 
be  made  on  a  case  by  case  basis. 


3.1  Preliminaries 

We  will  denote  by  the  maximum  of  the  pseudo-observability  indice.s  {p.}  (c/.  Definition 

1.6).  Similarly,  /c„,ax  will  denote  the  maximum  of  the  pseudo-controllability  indices  {ki}  {cf. 

Definition  1.7).  ...  .  • 

The  following  lemma  will  be  useful  to  to  define  the  identifiable  parameterizations. 

Lemma  3.1  :  Null  matrix  condition 

Given  {Nl{s),  Dl{s)}  and  {Nr{s),  Dr{s)],  a  left  and  a  right  MFD  of  a  (p  x  m)  strictly  causal 
system  with  observability  indices  {u,},  pseudo-observability  indices  {p.},  controllability  indices 
{/q},  and  pseudo-controllability  indices  {k,}, 

if  D{s)  G  i?.^'=P[s],  N{s)  €  with  q  arbitrary,  are  such  that; 

D{s)Nr{s)  =  N{s)Dr{s)  V  6  and  daD  <  -  1  or  dciD  <  p.-  -  1  Vz 
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or  if  Z)(5)  €  N{s)  G  with  q  arbitrary,  are  such  that: 

NLis)D{s)  =  Dl{s)N{s)  W  s  and  dr,D  <  fi-i  -  I  or  drqD  <  Ki  -  I  Vf 

then 

D{s)  =  0  N{s)  =  0 

The  proof  of  this  lemma  is  in  the  appendix. 


3.2  Identifiable  parameterization 

The  same  controller  structure  as  in  Section  2.2.1  is  used. 


3.2.1  Model  reference  adaptive  control 

Given  assumptions  (Al),  (A2),  (A.3)  of  Section  2.2.2,  we  show  that  there  exist  unique  controller 
parameters  values  such  tha.t  matches  7/,„. 

Proposition  3.1  :  Unique  model  reference  matching  ecjuality 

If  <9A,  =  ~  Ij  3  unique  controller  parameters  Cj  G  6''(s),  jD’(-s)  G  solution 

of  the  Diopharitine  equation: 

-  Cn^R  -  =:  H  (3.1) 

such  that  model  matching  is  achieved  (the  transfer  function  from  r  to  y-,,  is  H{s)),  D~  is 
proper,  is  strictly  proper,  and  D‘  satisfies  the  following  constraint 

dc,D-  <  -  1  Vz  (3.2) 

In  particular,  Cj  =  K~^  nonsingular  and  5/;C“  <  5A,-.  Similarly,  3  unique  C''{s)  and  jD‘(-s) 
G  such  that  model  matching  is  achieved,  D"  and  A“^C"  are  proper,  C’J^  =  /  —  A",,, 

and  dciD*  <  —  1- 

Proof 

The  proof  follows  the  same  lines  than  the  proof  of  Proposition  2.1.  The  matching  eciuality  (3.1) 
is  ecjuivalent  to 

CjAf-V  = /- A-'C' -  A-'iA*P  (3.3) 

Now,  let  [Ni,  Di,]  be  the  canonical  left  MFD  of  P{s)  {Dr  column  reduced,  dciDii-s)  =  Jq,  cf. 
Definition  1.13).  Using  the  polynomial  matrix  division  (Lemma.  2.2),  divide  AK~^H~^  on  the 
right  by  Dr,  then  3  Q(5),  A.(.s)  G  such  that 

AK~^H~^  =  QDr  +  B.  and  BDl^  is  strictly  proper 
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and  dciR  <  dc^Di,  =  Vi-  Then,  let 


d*  =  -r  =  qdl  -  rk;^h-^ 


c^  =  k-qnl  c;  =  k;^ 


It  can  be  easily  verified  that  the  given  Q,  C*,  D'  solve  the  matching  equality  (3.3)  with  ac.-T)’ 
<  z/,-  -  1.  Furthermore,  since  dXi  =  i/,nax  -  T  A-'T>*  is  proper.  On  the  other  hand, 

lim  A-'C*  -  lim  (/  -  K;^H-^P  -  A-^D'P)  =  1-1  =  0 

S-^OO  5-+0O  ^ 

so  that  is  strictly  proper  and  dr^C"  <  dXi  -  1  =  J^max  —  2. 

Now,  suppose  that  Q  +  ACo,  6’-  +  AC,  D'  +  AD  is  another  solution  to  the  matching 

equality.  Then 

ACo//~^F  +  A^'AC  +  A'^ADP  =  0 

and 

liai  ACoH~^ P  —  ACuA^j  =  0  ^  ACu  —  0 

5—^00 

ACDn  +  ADNn  =  0  and  dc,AD  <  v,  -  1 
by  the  null  matrix  condition  (Lemma  3.1) 

AC  =  AD  =  0 

So  that  the  solution  i.s  unique.  ,  ,  ^ 

Similarly,  dividing  on  the  right  by  Dl,  then  3  C(s),  R.{s)  G  such  that 

AH~'^=QDl  +  R  a.nd  RD'i  is  strictly  proper 

Let  _  _  - 

=  QDl  -  A//"'  C’  =  A-  QNl 

then  dciD^  <  -  1,  dr,C*  <  dXi,  =  I  -  K,,,  and  the  given  C’  and  P*  are  a  solution  ol 

the  matching  equality 

Nr[{A  -  C*)Dr  -  D'Nr]~^A  =  H 
Furthermore,  this  solution  is  unique.  D 

Corollary  3.1 

If  5A,  >  p,...  -  1,  3  unique  matrices  C*  G  C'(.s),  Z)*(.s)  G  such  that  mo^lel 

matching  is  achieved.  A"' D*  is  proper.  A"' C‘  is  strictly  proper,  Cj  =  ' ,  and  1- 

Similarly,  3  unique  matrices  C*(s)  and  D*[s)  G  such  that  model  matching  is  achieved, 

A~^D'  and  A“^C*  are  proper,  Cq^  =  I  —  Kp.  and  dc,D  <  Pi  —  D 
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The  proof  is  similar  to  the  proof  of  Proposition  3. 1  with  the  pseudo-canonical  left  MFD  replacing 
the  canonical  left  MFD. 

To  guarantee  parameter  convergence  of  the  MRAC  scheme,  the  uniqueness  of  9  must  be 
guaranteed  (0*  must  be  identifiable).  From  Proposition  3.1,  the  observability  indices  {i/,}  must 
be  known  and  must  be  constrained  so  that  5c,T)*  ^  1  and  u  =  This  can  be  done 

simply  by  having  the  j-th  column  of  A  =  0  if  v,  <  i.  An  advantage  of  uniqueness  is  that  the 
number  of  parameters  Ne  becomes  smaller,  l\g  =  p^i^mux  +  Note  also  that  Ng  —  2pn  if  the 
observability  indices  are  all  equal  and  that  Ng  =  2n  in  the  SISO  case,  as  expected. 

From  Corollary  3.1,  uniqueness  can  also  be  achieved  if  a  set  of  pseudo-observability  indices 
(/),}  is  known,  dXi  =  p  —  1  =  Pmax  —  1,  s-i^d  O'  is  constrained  so  that  dC  <  Pmax  ~  2  and 
dc,D'  <  p,  -  1.  Then,  Ng  =  p'^ +  pn.  ^  ^  _ 

In  the  case  of  the  extended  MRAC  (Section  2.3.2),  the__ uniqueness  of  (E’,C’RD*)  cannot 
1)0  guaranteed  even  with  the  constraint  dc,D'  S:  ~  R  (R  s^'d  D  aie  unicpie  onl}-  it  ^  is 

known).  Therefore,  parameter  convergence  cannot  be  ensured. 


3.2.2  Adaptive  pole  placement 

Given  as.sumption.s  (Al),  (A2),  (A3)  of  Section  2.2.3,  we  show  that  there  exist  unique  controller 
[)ara.ineters  values  such  that  'ijj,  matches  jy,„. 


Proposition  3.2  ;  Unique 
If  PA,  =  u  —  1,  and  ly  >  /p,.ax, 


pole  placement  matching  equality 

dCj  G  C'{s)  G  N'{s)  G  solution  of  the 


1 ) i o p ! ! a n t i n e  e c j u ?A  i o li ; 

[(A  -  C’)Dr  -  D-Nr]-N.C-  =  Dp/  (3-4) 

such  that  model  matching  is  achiex'Oxl,  A  'D  is  proper,  A  is  strictl_Y  piuper,  a.nd  D 

satisfies  the  following  constraint 

dc.:D‘  <  n,  —  1  Vi  (3-bj 

In  particular,  Up  =  rc[Dfi]  nonsingular,  and  di\C  <  dXi-^  Similarly,  C  G  3?  [^]  ^-iid 

p-  (z  such  that  model  matcluiig  is  acliieved.  A“'D*  and  A  A'*  are  proper,  = 

/-  rdDfi]-R  and  dc,D'  <  u.  -  1. 


Proof 

The  proof  is  similar  to  the  model  reference  case.  The  matching  equality  (3.4)  is  ecp-iivalent  to 


Since  {Nr,Vr}  are  coprime,  by  the  ISezout  identity  (Lemma  2.1),  3  f/£  G  U£  G 

NI^Nr  -i-  I'iDr  =  I  OlP  +  V[  =  Df.' 


Now,  let  {Nl,Dl)  be  the  canonical  left  MFD  of  P{s).  Using  the  polynomial  matrix  division 
(Lemma  2.2), ’divide  kT,[DR]DMUl  on  the  right  by  Dc,  then  3  Q{s),  E{s)  €  such  that 

Ar,[Dn]DMUl  =  QDL  +  R  and  RDl^  is  strictly  proper 
and  dciR  <  dciDi  —  Vi.  Then,  let 

D'  -R  =  QDl-  RRc[Dr]DmUI  C'  A- QNl-  R^c[Dr]DmVr  Co==Tc[Dr] 

It  is  easy  to  verify  that  the  given  Q,  C',  solve  the  matching  equality  (3.6)  and  dciD‘ 

<  iR  -  l'.  Furthermore,  since  dXi  >  -  1,  is  proper.  On  the  other  hand 

lim  =  lim(/  -  rc[DR]DM{UlP  +  V^)  -  A  P)  =  1-1  — 0 

S — ^OO  s — t-CO 

so  that  A“^C‘  is  strictly  proper  and  Or^C"  <  dX,  -  1. 

Now,  suppose  that  Cj  +  ACo,  +  AO,  +  AD  is  another  solution  to  the  matching 

eciuality.  Then 

ACoDmDjX  +  A-'AO  +  A~^ADP  =  0 

and 

lim  ACoDmDjX  =  ACoFjD/?]-'  =  0  =»  ACo  =  0 

5 — ‘CO 

->  AC  Dr  4-  A  D  An  =  0  and  <9c,:AD  <  n,  -  1 
by  the  null  matrix  condition  (Lemma  3.1) 

=y  AC  -  AC  =  0 


So  tliat  the  solution  is  unique. 

Similarly,  dividing  ADmUI  on  the  right  by  Dr,,  then  3  Q{s)^  R{^) 


G  such  that 


ADmUC  =  QDl  +  R  and  RD^^  is  strictly  proper 


Let 

JT  =  QDl  -  ADmUI  CC  =  A  -  QNr  -  ADmVL 
then  dciD^  <  A  -  1,  dr,C'  <  dX,,  CqU  =  ^  -  ^c[DrV\  and  the  given  C*  and  C*  are  a  solution 
of  the  matching  equality 

[(A  -  C‘)Dr  -  D^Nr]-U\  =  Dl} 

Furthermore,  this  solution  is  unique.  D 

Corollary  3.2 

If  c)A;  =  p-1  and  p  >  p.„ax,  3  unique  matrices  C’o  €  C‘(s)  €  5R''‘ [s] ,  ^“(*0  ^  '^rTn  ^1 

such  that  model  matching  is  achieved,  A-^ D’  is  proper,  A  'C*  is  strictly  proper,  Cj  -  I  d^fij 
and  5c, C*  <  p.  -  1.  Similarly,  3  unique  matrices^  C‘  €  and  D'  G  such 

that  model  matching  is  achieved,  A“’jD‘  and  A  are  propei,  —  I  —  FclDfl]  ,  anc 

5c, D-  <  p.  -  1. 
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The  proof  is  similar  to  the  proof  of  Proposition  3.2  with  the  pseudo-canonical  left  MFD  replacing 
the  canonical  left  MFD. 

Now,  we  show  that  there  exist  unique  matrices  f/£  and  satisfaying  the  Bezout  identity 

(2.20). 

Proposition  3.3  :  Uniqueness  of  the  Bezout  identity 

Given  a  right  coprime  MFD  {Nh^Dr],  3  unique  matrices  G  such 

that 

V[Dr  +  UINr  =  1  and  5c,d7£  <  u,  -  1 
Furthermore,  dV£  <  dUl  <  i/,uax  ~  F 

Proof  _  _  r  1  , 

Since  {Nr,  Dr)  arc  copriinc,  we  know  there  exists  a  solution  U i,  G  IT  G  [.s]  such 

that 

\\Dr  +  [JiNr  =  / 

Divide  Ur  on  the  right  by  Dr,  where  [Nr,  Dr}  is  a  canonical  left,  MFD  (see  Definition  1.13), 
then  by  the  polynomial  matrix  division  (Lemma  2.2)  3  Qr  and  Ur  G  IP  '  [-^l  ^’'-'^h  that 

[T  =  QrDr  +  U'r  and  i.s  strictly  proper 


and  dc,Ul  <  I',  -  1.  Now  let 


IT  =  14  +  QrNr 


It  can  be  easih'  verified  tlia,t  Ur,  Vr 
Ul  -r  NUr,  Vr  V  AI4  is  another  so 


;  also  a  solution  of  the  Bezout  identity.  Now,  supi)ose  tliat 
lion  such  that  4  -  1  •  Then 


U^UrNr  +  AVrDr  =  0  and  dc,/\UR  <  //,  -  1 


by  the  null  matrix  condition  (Lemma  3.1) 

=y  NUr  =  A 14  =  0 


so  that  the  solution  is  unique. 

Furthermore,  from  (2.20),  we  have  that  OVr  <  dU r  <  n,na,x  “  1- 


Corollary  3.3 

Given  a.  right  coprirne  Mb  D  {Ur,  Unj,  3  unique  matiK.es  Ur  G  A  ^  [.sj,  G  A 
that 

VrDr  -h  U'r  Nr  =  I  and  dcMl  <  f>,  -  1  V  i. 


psi  such 


Furthermore,  dV[  <  dUl  <  Pui.xx  —  1- 
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The  proof  is  similar  to  the  proof  of  Proposition  3.3  with  the  pseudo-canonical  left  MFD  replacing 
the  canonical  left  MFD. 

Similarly,  to  Section  2.3.3,  we  must  guarantee  that,  for  all  inputs  n,  equation  (2.21)  has 
a  solution  which  is  also  the  solution  of  the  pole  placement  matching  equality  (2.19)  and  the 
Bezout  identity  (2.20). 

Proposition  3.4  :  Unique  equivalence  of  (2.21)  with  (2.19)  and  (2.20) 

If 

d Xi  —  /iin.i.x  f^i  T  ^max  1 

then  there  exists  a  solution  (7“,  D"  ot  the  matching  equality  (2.19)  such  that 

<  /A  -  1 

dr,C~  <  /q,L.=ix  l‘i  +  'Aiiax  1 

c)CiC-'  T  /^ina.x  V  ^''iiia.x  2 

=  (/-U[/.)fi]-')„=:0  if  i>j  (3.7) 

Furthermore,  under  the.se  constraints,  any  solution  of  (2.21)  valid  for  all  n  is  also  a  solution  of 
(2.19)  and  (2.20). 

T'he  proof  is  almost  identical  to  the  prool  ol  Proposition  2.4  and  will  he  omitted  heie. 

Corollary^  3.4 
If 

O'.  -  ,,  _  .  V  a  —  1 

then  there  exists  a  solution  C',D~  ol  the  matching  equality  (2.19)  such  that 


dc,D'‘ 

dr-iC* 


<  f),  -  1 

<  /4uax  “  +  Pinax  ~  1 

<  /4iiax  —  /'i  +  Piaax  “  2 

=  (/-rjDK]-').q  =  o  if  z>J 


(3.8) 


Furthermore,  under  these  constraints,  a.ny  solution  of  (2.21)  valid  for  all  //.  is  also  a  solution  of 
(2.19)  and  (2.20). 


The  proof  is  similar  to  the  proof  of  Proposition  2.4  but  relies  on  Corollary  3.2  in.steau  oi 
Proposition  2.2. 

Coaseciuently,  uniqueness  ot  0~  is  not  guaranteed,  unless  the  observability  indices  {v,}  aie 
known  (c/.  Pro[)ositioas  3.2,  3.3,  and  3.4).  and  0"  is  constrained  so  that  u  =  r'max)  dc,D  <  i\  1, 
and  dc,Ul  <  n.  -  1.  Then,  No  is  sinallei 


2m^(v„.^,,  -  1)  -h  2mn  <  No  <  2m^(;/,„,.,,  -  1)  +  m(m/q, +  n) 
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Note  that  N$  =  2771.^ (z^i„ax  —  1) +  277!.?!  if  the  controllability  indices  are  all  equal,  and  =477  —  2 
in  the  SISO  case.  Our  algorithm  is  comparable  to  the  discrete-time  algorithm  of  Willner  et  al. 
[34],  wdth  some  nontrivial  differences  between  the  continuous-time  and  discrete-time  algorithms. 

From  Corollaries  3.2,  3.3,  and  3.4  uniqueness  can  also  be  achieved  if  a  set  of  pseudo¬ 
observability  indices  {p.-}  is  known,  p  =  Pmax,  dl  =  p  -  1,  ^A.-  =  /i„,ax  -  Pi  +  P  -  1,  and 
0^  is  constrained  so  that  dV£  <  -  2,  5c.f/£  <  p.  -  1,  C"  obeys  to  (3.8),  and  dc^D-  <  p;  -  1. 

Then, 

2'm^(p,nax  “  1)  +  27/777  <  Ng  <  2?77^(pmax  l)  +  ^(^Fmax  +  Tt) 


3.2.3  Recursive  identification 

To  guarantee  uniqueness  of  0\  a  pseudo-canonical  or  a  canonical  parameterization  must  be 
used  for  the  recursive  identification  (c/.  Section  2.3.4). 


Identification  of  pseudo-canonical  MFD 

A.ssume  that  {AT(^),^n(d}  «  pseudo-canonical  left  MFD  of  the  strictly  proper  transfer 

function  matrix  P(s),  with  pseudo-obseiA'ability  indices  {pi}-  Define  A(.s)  diag{(.s -h  r/)  } 

and  L(.s)  ^  diag{(s  -f  }  with  a  >  0,  then 

L-i[y,,l  =  A-'  /Vr  M]  -  A-TD/,.  -  /mF\)[p,]  (3.9) 

Equation  (3.9)  is  an  equation  where  the  unknown  parameters  appear  linearly,  i.t., 


(3.10) 


where  O’  is  a  properly  defined  [{,i  ^  ////y.a.O  >■  p)  ■'‘'“'’^trix  of  unknown  parameters  and  D  a 
(■/7 -f  777p„,ax)  rcgressor  vector  defined  as 


•0^  = 


(6+ a) 

_ vpi _  ^  ypi 


(6-f 

yp2 _ 


ypp 


+  (iT-n)''‘ 


(s-i-u}/--. 


(3.11) 


Then,  the  following  linear  equation  error  can  be  defined 

e,  =  -  L-'  [n,]  =  {e^  -  (r'^yip  =  (3.12) 

Note  that  the  parameters  d',,  i  =  1,  1  -r  p.„..x, .  .  •  M  +  [m  -  l)pn-,ax,  J  siv-li  Pj  <  Pui.ax,  arc 

always  eciual  to  zero  and  do'iiol  need  to  be  icleiitihed.  1  lie  uum'ber  of- parameters  to  idenlily 

p[n  -b  —  ni[p  -  1)  <  Ng  <  p{n  -f  /ripin.-ix) 

Unfortunately,  since  the  estimate  of  Dl{s)  is  generally  not  row  reduced,  the  conditions  on  the 
row  degrees  of  AT(.s)  are  not  sufficient  to  guarantee  that  the  estimate  of  the  system  is  strictly 
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proper.  To  guarantee  strict  properness,  the  linear  estimation  algorithm  must  be  modifiecl  by 
adding  constraints  on  the  estimates  of  the  parameters.  An  example  of  such  modifications  can 
be  found  in  Correa  &  Glover  [52,  53]. 

Finally,  it  should  be  pointed  out  that  other  definitions  for  the  filters  A{s)  and  T(s)  can 
be  used  without  altering  the  conclusions  of  this  work.  Our  filter  was  intentionally  selected 
to  simplify  notation.  Any  filters  of  the  type  A(s)  =  diag{A,(s)}  with  A.'(s)  stable  and  5A,-  > 
max(p„p,„ax  -  1)  could  be  used  instead.  The  same  is  true  for  the  regressor  vector  •(/>.  Other 
filtered' signals  could  be  selected  to  form  the  regressor  vector  as  long  as  there  exists  a  unique 
matrix  d*  such  that  equation  (3.10)  is  verified. 


Identification  of  canonical  MFD 

A  similar  scheme  can  be  used  for  the  identification  ol  canonical  left  MFD  than  for  the  iden¬ 
tification  of  pseudo-canonical  left  MFD’s.  A  difference  is  that  the  row  degrees  of  the  matrix 
Dl{-s)  are  also  equal  to  the  observability  indices  Ui  and,  consequently,  less  parameters  need  to 
be  estimated.  Also,  since  the  estimated  matrix  is  row  reduced,  the  estimated  system  is 

guaranteed  to  be  strictly  proper.  So,  assume  that  {Ni{s),  D is  a  canonical  left  MFD  of 
the  strictly  proper  transfer  function  matrix  P(s),  with  observability  indices  {;/,}.  Let  A(s)  be 
a  filter  matrix  defined  by  A(.s)  =  diag{(s  +  a)"'}  with  u  >  0.  Note  tha,t  any  filters  of  the  type 
A(.s)  =  diag(A.(s)}  with  A.(.s)  stable  and  dA,  >  iq  could  also  be  used,  iheri 


A-’AT[r']- 


(3.13) 


which  can  be  more  compactly  rewritten 

y^,=0f-d>.  t  =  (3-14) 

where  6~  and  A  r  =  1  .  .  .  ,  are  respectively  parameter  vectors  and  regressor  vectors  of  dirnen- 
"on.Vn  +  dl.  (with  kL  =  n  We  let  .  =  1.. . ,  be  given  by 


‘ijjj 


Vp] 


(j  +  a)  +  (s+a) 


yp,. 


(s+a)^  +  )-i-l 

yp.  yp,  _ ypi^i 


-  +  1  ).»^2  )  +  ^ 


(i'  +  a)".  (5  +  a) 


(5-}-tt) 


Therefore,  the  following  error  equations  can  be  derived 

C,  =.  dfDt  -  J/r,  =  =  dfv,  r  =  l> 

^  C2  =  block  diagjd^'d’t}  “  Vv  —  “  i'A 

where  0,  is  the  estimate  of  G‘-  The  number  of  parameters  to  identity  is  smaller 


(3.15) 


(3.10) 
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Also,  Ns  is  genera-lly  smaller  (at  most  equal)  than  in  the  pseudo-canonical  case.  For  example,  if 
■p  =  3,  ?n  =  2,  n  =  6,  {i/,}  =  {3, 1,2},  and  {p.}  =  {z/,},  then  No  =  28  in  the  canonical  case  and 
Ns  =  32  in  the  pseudo-canonical  case.  Finally,  note  that  No  =  p(p  +  m)t/,nax  if  the  observability 
indices  are  all  equal  and  that  No  =  2n  in  the  SISO  case,  as  expected. 

3.2.4  Comparison 

This  section  makes  a  general  comparison  of  the  identifiable  parameterizations  presented  in  this 
chapter  in  terms  of  necessary  a  priori  information  and  number  of  parameters  to  identify.  Table 
3.1  summarizes  the  previous  results  concerning  the  a  priori  information  and  the  number  ol 
adaptive  parameters  required  b}'  the  different  algorithms.  Uniqueness  is  directly  lelated  to  the 


Alp;orithm 

A  priori  iufonnatiou 

No 

Direct  MR.A.C  +  uniqueness 

+  P"- 

Direct  MRAC  -f  uniqueness 

yff  Pui.-xx  +  ynz 

Direct  PPAC  -f  uniqueness 

{/Fd-3 

<  2m'3Du.i.x  -  1)  +  +  '0 

>  2/n8(/''ii,,Tx  ~  l)  “b  '2'm'ii. 

Direct  PPAC  -f  uni([ucness 

{/ddA} 

<  2in.‘(AnA.x  -  i)  -f  'm.('m/i,„„x  +  "■) 

>  -  1)  +  2inn 

Rcc.  ident.  +  uniqueness 

{a} 

<  (p  -f  ■in)'ii 

R.ec.  ident.  +  uiii([iieiies3 

{/>.} 

<  p(vi  +  rn.p,,,,.,,^) 

>  p{n  -f  -  {[’  -  1)'« 

Table  3.1:  A  priori  information  and  number  of  parameters  in  identifiable  parameteriza.tions 


knowledge  of  the  observability  indices  (or  a  set  ot  pseudo-observability  indices),  a  fa.ct  that  can 
be  traced  back  to  Lemma  3.1.  Table  3.1,  underlines  the  fact  that  uniqueness  (identifiabihty)  is 
obtained  through  increased  a  pWorf  information,  i.t.,  the  knowledge  ol  the  observability  indices 
instead  of  an  upper  bound  on  the  observability  index.  Only  the  a  priori  information  relevant 
to  the  parameterization  is  shown  in  Table  3.1.  Other  assumptions  may  be  needed  lor  stability 
considerations.  These  assumptions  are  summarized  in  Table  2.2. 

3.3  Frequency  domain  conditions 

In  the  previous  sections,  we  presented  identifiable  parameterizations  loi  the  three  schemes, 
direct  hlRAC,  direct  PPAC,  and  recursive  ideatilicatioii.  Now,  parameter  convergence  can  be 
guaranteed  if  the  regressor  vector  -ip  is  SE  or  PE  (c/.  Definitions  2.2),  2.1),  and  Lemma  2.3).  It 
the  regressor  vector  i/i  is  SE  or  PE,  then  0  =  0'.  With  nonidentifiable  parameterizations. 
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the  regressor  'tp  may  7ieuer  be  SE  or  PE.  The  problem  with  such  a  condition  is  that  it  constrains 
time  signals  that  are  interrelated  and  not  freely  available  to  the  designer.  In  particular,  the 
condition  may  never  be  satisfied,  as  happens  when  the  parameterization  is  not  identifiable. 
Therefore,  parameter  convergence  conditions  are  not  of  any  real  use  unless  they  are  translated 
into  conditions  on  the  external  inputs  of  the. adaptive  system.  This  has  been  done,  using 
generalized  harmonic  anal3^sis,  by  Boyd  &  Sastry  [66]  in  the  SISO  case  and  by  de  Mathelin  & 
Bodson  [65]  in  recursive  multivariable  identification.  Similarly,  we  translate  in  this  section  the 
PE  condition  on  i/'  into  simple  conditions  on  the  reference  input.  Note  that  guaranteeing  the 
PE  condition  is  more  interesting  than  guaranteeing  the  SE  condition  since  the  PE  condition 
provides  exponential  convergence  (c/.  Lemma  2.3  for  the  least-squares  with  covariance  resetting, 
and  Anderson  [6S]),  while  the  SE  conditions  provides  only  asymptotic  convergence. 


3.3.1  MRAC  convergence  results 

VVe  use  the  same  approach  than  Boyd  k  Sastry  [66]  and  de  Mathelin  k.  Bodson  [65],  to  obtain 
the  following  results. 


Theorem  3.1  :  Frequency  domain  conditions  for  parameter  convergence  Direct 
MRAC  with  K.,  known 


Let  the  inputs  r,  be  .stal  ionary  and  unconelated  (different  frequencies  in  each  input)  and  assume 
that  the  observabilitv  indices  {i/,-}  are  known,  the  corresponding  identifiable  parameterization 
is  used,  and  the  condiiions  ol  Theoreiu  2.1  are  satisfieu. 

i.  If,  for  ail  r,  the  support  of  the  spectral  measure  oi  the  t-th  input,  ooutauis  at  lea.^u 

q-  _  p  different  values  of  w,  then  as  t  — >  co,  0  B’  initial  conditions. 


2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  Sr[uj)^  does  not 
contain  at  least  n  +  p(n, -  1)  different  values  of  w,  then  as  f  -a  oo,  d  A  B'  for  almost 
all  initial  conditions. 


Corollary  3.1 

Let  the  inputs  r,  be  stationary  and  uncorrelated  (different  frequencies  in  each  input)  and  as¬ 
sume  that  a  set  of  pseudo-observability  indices  {p,}  is  known,  the  corresponding  identifiable 
parameterization  is  used,  and  the  conditions  of  Theorem  2.1  aie  satisfied. 

1.  If,  for  all  z,  the  support  of  the  spectral  measure  of  the  i-th  input,  5V. (w)  contains  at  lea.st 

11  -|_  —  p  different  values  of  to,  then  as  t  — >  co,  0  >  0  initial  conditions. 

2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  Sn{io-)  does  not 

contain  at  least  ii  +  -  1)  different  values  of  up  then  as  /  ^  oo,  d  A  O'  for  almost 

all  initial  conditions. 
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Theorem  3.2  :  Frequency  domain  conditions  for  parameter  convergence  -  Diiect 
MRAC  with  Kp  unknown 

Let  the  inputs  r,-  be  stationary  and  uncorrelated  (different  frequencies  in  each  input)  and  assume 
that  the  observability  indices  {r/.}  are  known,  the  corresponding  identifiable  parameterization 
is  used,  and  the  conditions  of  Theorem  2.2  or  Theorem  4.1  are  satisfied. 

1.  If,  for  all  i,  the  support  of  the  spectral  measure  of  the  i-th  input,  Sr,{to)  contains  at  least 
n  +  i/.uax  -  p  +  1  different  values  of  cu,  then  ^ls  t  co,  0  O' ,  V  initial  conditions. 

2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  Sr{u})  does  not 

contain  at  least  n  +  pvmax  different  values  of  lj,  then  as  t  oo,  6  0  foi  almost  a.11 

initial  conditions. 


Corollary  3.2 

Let  the  inputs  r,  be  stationary  and  imcorielated  (different  freciuencies  in  each  input)  and  as¬ 
sume  that  a  set  of  pseudo-observability  indices  {p,}  is  known,  the  corresponding  identifiable 
parameterization  is  used,  and  the  conditions  of  Theorem  2.2  or  Theorem  4.1  are  satisfied. 

1.  If,  for  all  z,  the  support  of  tlie  spectral  mea.surc  of  the  z-th  input,  SrX'^')  contains  at  least 

.,,.’4-  -  p  +  1  different  values  of  a-n  then  as  I.  cg,  0  ()\  Vdnitial  conditions. 

2.  If  the  supiiort  of  the  spectral  measure  of  the  inputs  taken  altogether,  does  not 

conta.in  at  least  n  +  j)p„,..x  differcn!  values  of  then  as  i  co,  d  7L  O'  tor  almosr.  all 
initial  conditions. 


The  proof  of  Theorem  3.1  is  a  trivial  simplification  of  the  proof  of  Th.eorem  3.2  given  below. 
The  proof  of  Coiolkumv  3.1  and  3.2  arc  easik.'  derived  from  the  proof  of  Theormn^  d.  '  a-d  3 
by  simply  using  the  identifiable  controller  parameterization  based  on  the  pseudo-obscrvabilny 
inclices  instead  of  the  parameterization  based  on  the  observability  indices.  For  the  interpretation 
of  the  results,  it  should  be  noted  that  one  sinusoid,  contributes  to  rwo  trequeiicy 

components,  at  -f-roo  and  — u-y. 


Proof  of  Theorem  3.2 

Since  e,/,  G  L2  and  hm(_.cc.  cy  ~  ^  (fi^'  Theorems  2.1,  2.2,  and  4.1) 

■d  PE  yy  PE 

(cf.  Lemma  2.6.6  in  Sastry  &  Dodson  [3]).  Since  tlic  reference  input  r  is  assumed  stationary 

da.  PE  4^  /fy,..(0)  >  U 

where  Fy„.(Ej  i-''  fP'’  autocorrelation  of  ■dy.Jd)-  D.v  fhe  properticas  of  tlie  autocorrelation 
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where  SR{tj)  is  the  spectral  measure  of  r,  e.g.,  Sr{u)  =  diag{5ri(t^)}  d  the  m  =  p  reference 
inputs  n  are  uncorrelated  (different  frequencies  by  input  signal).  Since  the  identifiable  param¬ 
eterization  is  used  (see  Section  3.2.1),  the  (n  -bpr'max)  P  transfer  function  matiix  H-^^t  has 
the  following  form  (c/.  equations  (2.13)  and  (2.30)) 

diag{y^} 

_ ^ //(.s) 

where  is  equed  to  the  identity  matrix  I  without  the  rows  !j  .such  that  //,  <  i.  For  example, 
if;;  =  3,n  =  G,  {n,}  =  {3,  1,2}  thea 


■  1  0  0  ' 

=  0  1  0  T- 

0  0  1 


Moo 


T'^  =  i  0  0 


Part  1:  To  establish  the  first  part  of  the  theorem  we  use  the  following  intermediate  result: 
Let  Mmo-  denote  the  z-th  column  of  and  let  Nj  =  n  +  -  />  +  1-  Then,  tor  all  set  of 

distinct  {s,j  e  C},  z  =  1, . .  .  ,p,  J  =  1,  •  ■  ■  ,  M.  such  that  '''-eh  defined,  the  rows  of 

the  matrix 

are  linearly  independent  in  ^  ^  _ 

This  intermediate  result  is  proved  in  the  following  manner.  Suiqmse  that  the  proposition 

was  not  true.  Then,  tliere  would  exist  a  \-ector  k  G  ^  0,  .such  that: 

r’'[  Hi . ,w«,)]  =  l»  ■■■ 


T  lT  —  I  i-T  ...  k't'  ]  where  f,  is  an  (v  =  in)  dimensional  vector  for  z  —  1, . . . ,  iq,mx  and 
an  (<  p)  dimensional  vector  tor  z  =  +  1,  •  •  • ,  2//.„.x  Ac.,  with  a  dimemsion  equal  to  the 
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number  of  rows  of  Then,  given  the  definition  of 


0  =  ki- 


+  ^2 


Hi,,)  i(i.,)Ki,i) 


[P  ^  H)t{sij)  +  , . .  +  k 


T 


,X^rnax  -2 
^0’ 


i^rn.vx  +  1 


1 


l{sij)X{sij ) 

^tn  a  X  “  2 

r---'Hi(sij) 


(e-W),(j,-,)  + 


)  A  j 

+  . V  z  =  1 , . . . ,  p  and  j  =  l,...,Nf 


l{sij)' 


(3.17) 


where  {P~'^H)i{s)  is  the  z-th  column  of  (P'''//)(5),  H,{s)  the  z-th  column  of  H{s),  and  /zi.  the 
z'-th  element  of  the  vector  ki. 

Given  the  definition  of  the  Hermite  normal  form  H{s)  (Definition  1.4),  3/t,-,  1  <  ki  <  r,„ax 
such  that  tlie  greatest  common  denominator  of  the  elements  of  Hi{s)  is  e([ual  to  (.s  +  z/.)^*'.  Since 
liiUj— (x,  T’~^(s)/7(.s)  =  nonsiiigular,  if  {Nc,Dl}  ^I'e  coprime  then 


V 

<9det  AT  =  f}det  —  5det  H~^{s)  —  n  —  'Yl 

Z-l 


Therefore,  if  we  define  z/,(.s)  ;us  tiie  smallest  common  denoiuiaator  of  {P  '  //),(.s)  =  AT  ^{s)Dl{s) 
J~P{s),  then  z/,(s)  =  det  AT('S)(-s  +  and 

1’ 

(5</i(-s)  =  T  ki  -  '4-  <  zz  —  p  +  1 


since  Vj.  >  1  V/.'.  Now,  if  wc  multipl}’  both  sides  of  (3.1/)  by  /(.s,j)A(.s,_,  |('/,(.s,.,-) 

0  =  /zi,A(-s,.)z/,(.s.,)  +  A:.T(P”^i7):(s,,)'7-(-?.'j) +  ■‘'o'''*  '{P  ' 

+  kY,,^,,  A(s,p)7''"“‘'>‘/A  (.?;  Az/,(.sp)  V  z  =  1, .  .  .  ,  P  and  j  =  1,  .  .  .  .  Nj 

These  are  p  polynomial  equations,  each  with  degree  <  /^nax  +  zz  —  /;  +  1.  Consequently,  it 
AT  >  '4nax  +  n  —  P  +  1,  these  equations  cannot  be  verified  unless  they  are  verified  V  .5  or 
equivalently  if 


0  -  kj  J—  +  k 


p-'(.C//W  +  ---  +  rL,TyP)a-o)//(.n  + 


1 


U 1 


l{s)  '  l{s)\[s) 


1 


0  =  kj H-\s)P{s)  +  ^[Cj  +  ,s/c[  +  .  . .  + 

1 


+  AW . 


..x-2//i'  7^1-'n.;,x-l  I  \/..\lT  rpuu 


+  Hi)kLr . \PU) 


C'2 


If  vve  take  the  lim^^oo, 


we  obtain 


kjKp  =  0  ^  A;i=0 


so  that 


0  =  [Af  +  skj  +  ...  +  ^K^,JDr{s) 


and  by  the  null  matrix  condition  (Lemma  3.1) 

k^=0  Vz  =  2,... /2/y, 


A-  =  0 


which  proves  our  intermcclicite  result. 

Now,  suppose  (0)  0-  Then,  there  exists  a  vector  k  G  L  ^  0  such  that 

l+k^  k^' H^,,,  r{j<^’)SR{(^')H'^^^^,{ju)k  du  =  0.  From  our  intermediate  residt,  k^ =  0  lor 
. . .  )/hs  not  possibKor  n  +  zy^ax  -  p  +  1  different  values  of  u.-,.  Therefore  5V,(a.')  >  0  tor 
less  than  n  +  //,„ax  —  j'  +  1  values  of  a.’,  which  contradicts  the  hypothesi.s  of  the  first  part  of  the 

theoiem. 


Part  2;  Let  Ni  <  n  +  /z;/,„ax-  Then,  for  all  set  oi  {s,  t  C},  z  1, 
is  well  defined,  tiie  rows  ot  the  matrix 


J  *  SU(.dl  t  lici  t  T' V. ‘  } 


are  linearly  dependent  in  C'T,  since  the  number  of  rows  (;i  +  pzy„,xx)  >  A/  number  of 
columns.  Consequently,  if  there  are  less  than  vr  +  pzA..,«  different  values  of  co  in  the  support 
of  Sr{uj),  then  there  exists  a  vector  k  G  32'“'^^''"”,/:  0  such  that  k 

//C  {ioj)k  du  =  0.  Therefore,  ^  0-  This  implies  that  does  not  converge  to  zero, 

unless  the  initial  error  <^(0)  lies  exactly  in  the  null  space  of  (cf.  Sastry  k  Bodson  [3]). 

□ 


3.3.2  PPAC  convergence  results 

Similarly  to  the  MRAC  case,  PE  conditions  can  be  translated  into  conditions  on  the  refer cncc 
in  pul. 

Theorem  3.3  :  Frequency  domain  conditions  for  parameter  convergence  -  Direct 

PPAC 

Let  the  inputs  r,  be  stationary  and  uncorrelated  (different  Irequencies  in  each  input)  and  assume 
tliat  the  observability  indices  {i/J  are  known,  the  corresponding  identifiable  parameterization 
is  used,  and  conditions  ot  Theorem  2.3  are  satisfied. 


1.  If,  for  all  2,  the  support  of  the  spectral  niea.sure  ot  the  z-th  input,  5r,  (u;)  contains  at  least 

(m  +  -  1)  +  nz/iinax  +  /';  different  values  of  u,  then  as  t  ^  oo,  0  6'“  V  initial 

conditions. 

2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  Sr{u)  does  not 

contain  at  least  n  +  2m(i/max  -  1)  +  different  values  of  u,  then  as  t  co,  6  6^ 

for  almost  all  initial  conditions. 


Corollary  3.3 

Let  the  inputs  r,-  be  stationary  and  uncorrelated  (different  frequencies  in  each  input)  and  as¬ 
sume  that  a  set  of  pseudo-observability  indices  {/),}  is  known,  the  corresponding  identifiable 
[)araineterization  is  used,  and  conditions  of  db.corem  2.3  are  satisfied. 

1.  If,  for  all  2,  the  support  of  the  spectral  inea.sure  ol  the  z-tli  input,  .S,._(u.’)  contains  at  least 
(■m  -f  l){pinr,x  —  1)  +  m/'iuax  +  Pi  different  values  of  to,  then  a..s  t  —>  oo,  0  O’  V  initial 
conditions. 

2.  If  the  support  of  the  spectral  measure  of  tin'  inputs  taken  altogether,  Sr{uj)  does  not 

contain  at  least  n  -f  2m(p,.,ax  -  1)  -r  different  values  of  u,  then  as  t  oo,  0  B’ 

for  almost  all  initial  conditions. 

The  proof  of  (Jorollary  3.3  is  easily  derived  trom  the  prool  oi  Theorem  3.3  by  simply  using  the 
identifiable  controller  parameterization  based  on  the  pseudo-observability  indices  instead  ot  the 
[lara.meterization  ba.sed  on  the  oliscrvaluhiy  inihces. 


Proof  of  Theorem  3.3 

Part  1:  We  prove  the  result  by  contradiction.  Suppose  that  i/i  is  not  PE.  Since  the  conditions 
of  Theorem  2.3  are  satisfied,  we  have  that  !im,._c,  0{i)  =  0^^  and  from  the  proof  of  Theorem 
2.3, 

•'/’  -  ■'/•’oo  =  -  0^)^w\ 

Therefore,  since  is  strictly  proper  and  stable,  lim(_*oo  ('</'  ^  '0oo)  =  0  and 

■tp  not  PE  ^  (/'co  PE 

Since  the  reference  input  r  is  assumed  stationary 

■'Tc  not  PL  /fe  JO)  T  0 


where  i-"'  the  autocorrelation  ot  and 


(.4 


where  Sr{u))  is  the  spectral  measure  of  r.  See  the  identifiable  parameterization  is  used  (see 
Section  3.2.2),  the  (2'm(n.nax  -  1)  +  +  n)  x  m  transfer  function  matrix  has  the 

following  form  (c/.  equations  (2.23)  and  (7.1)) 


+  -2  -Mrnin  -1  D  fi(s)Q  (s)  A{s) 

l(s)-y{s) 

j^^T'Nn{s)Q-\s)K3) 


c^^fna  X  ~  1  m 


Nn{s)Q-\s)  A{.s] 


-^,Dn{s)Q-\s)A{s) 

Dr{s)Q-\s)  A{.s) 

^rh\m(s)Q-'(-0A(-^) 

A!!i^r'--Nnm-'{s)A{s) 

where  0(s)  =  (A(s)  -  a,(.s))/?fi(.5)  -  t^R{s),  T  is  equal  to  the  (p  x  j,)  identity  matn: 

4  without  the  rows  7;,^  such  that  //^  <  i,  and  5'^  is  equal  to  the  {m  x  ni)  identity  matiix  ,, 
without  the  rows  such  that  -  pi  +  i/,..a,x  -  1  <  For  example,  if  m  =  3,  /r  =  = 

2,  {/a}  =  {3, 1,2}  then 


,  ^  -  0  10 
5-=.  0  1  0  5-=  Q  ^ 


0  0  1 


S'-^  =  [  0  1  o' 


Note  that  Q  ^(s)A(s)  —  Dn,i{-s)  it  —  d  and  'ipoo  — 

We  need  now  to  establish  the  tollowing  intermediate  icsult. 

Let  denote  the  f-tli  column  of  7/,^,  .  and  let  .W  -  (-m.  H-  1)(/a,„.,x  -  1)  - 

Then,  for  all  set  of  distinct  {.s,j  G  C) ,  /  =  i ,  .  .  .  ,  in,  j  =  1 , .  .  .  ,  Ay, ,  'Such  that  7/^;..^ ,  {s,j )  is  we,, 
defined,  the  rows  ot  the  matrix 

I  77,^/,^ri  (-^11  )  •••  Ac^.r,  (si.V^^  )  77^/,^,.,  (..S'Jl  )  .■•  77,/,,^,,„(s„iAq,„  ) 

arc  linearly  independent  in  C^'=> 
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This  interniediate  result  is  proved  in  the  same  manner  as  for  Theorem  3.2.  Suppose  that 
the  proposition  was  not  true.  Then,  there  would  exist  a  vector  k  G  C  ^  “  )  e  ^0, 

such  that;  , 

•••  J  =  [  ^  ^  | 

,  where  the  subvectors  k  are  properly  dimensioned  so 


Let  —  I  ••• 

[  be  rew: 

0  =  kl,,  + 


that  the  previous  equation  can  be  rewritten  as 

1 


(Sij ) 


^/-rnax  /^rni n  K  2 


-kk 


/d 


T  ^  o 

Z^tcax  —  Z^rr.in  ~  1 

T  _ 


1 


DRis.,)Q-^(Si,) 


Z^iti.i  X  /*  ftii  II  “f"^''ui.>  * 


“  l{s,j)(h{s 


T'AT(-s,y)QrH-^u)  +  • 


U  / 


+// 

‘  (hu.yK-k 


■  O' 


T‘'--yVK(.sp)Qr  (-^o) 


+  k'^' 

'  /'rn.iK  -/'iniii . 


-I-/. 


T 

/L'fi.a X  rni  n  ^in.i  X  2 


"  0 


On{s,j)Qi  ’(.s.j)  +  . 

A,(sp) 


u./- 


^-1  \ 


^  X  mill  “2 


l{s. 


y  z  =  I ,  .  •  ■  ,  ui  and  j  =  1 , .  ■  .  ,  A  /, 


where  QT^{s)  is  the  z-th  column  of  Q~^{s).  Suppose  that  (j,{s)  is  the  smallest  common  de¬ 
nominator  of  Q.  '(-s),  then  <9(y,  T  (9det(Q)  T  T  ^ma.'c  f)  a,nfi  d(^DfiQ.  ijiA.,)  T  d(j, 

<  ~  !)•  Note  that  i/,(s)  =  7(.s)  if  'i/’oo  =  0m- 

Now,  if  we  multiply  both  sides  of  (3.18)  by  1{-Sij)di[sij)qi[s,j),  we  obtain  a  system  of  m 
polynomial  equations  with  degree  <  {m  +  l)(iqaax  —  1)  +  ''Ty'-max  +  /y-  Conseciuently,  if  Ay_  > 
(771  +  l)(i.'„,ax  -  1)  +  '0)/q„ax  +  /Au  V  7  =  1, .  .  .  ,  777,  tlicse  cquations  cannot  be  verified  unless  they 
are  verified  V  s  or  eciuivalently  it 


1  /rz/'cL  I  I  +Z'iii.\x  ~2  q/i[(.AX  ZZji.ilt  M  /Inf  si 

—  ([Aq  T-  .  . .  +  -1 5  O  ny  ) 


7(.‘ 

+  [0:,.x-e,„„A . X 


jJ 

/‘Hi  ax  /Z  jIUll  "1“2 X  ■ 


_  (\lJ  ^  _L 

'  •••  *  Oi  ma  x  - // ini  n +3  ^'max 


i.s'""‘--’T'''"-iAT(.s)) 
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+  [k 


T 

/^rnAx 


+  .  ,  j,  ns' 

i:\ix  rni  n  *1“'’  t^rnax  ^ 


c-1 


T‘'‘"-'']Nr(s)) 


The  left  side  of  this  equation  is  strictly  proper  and  the  right  side  is  polynomial,  so  that  both 
sides  must  be  identically  zero.  Then,  by  the  null  matrix  condition  (Lemma  3.1) 


ki  —  0  V  2  =  1,  ...  ,  /r,nax  “  /^min  +  4t'max  “2  =>  k  —  0 


which  proves  the  intermediate  result. 

Since  0,  there  exists  a  vector  k  £  g^2zn(..„a. -i ax +n ^  ^  0  such  that 

Sfi{uj)  Hf^^{juj)k  duj  =  0.  Since,  we  proved  in  the  intermediate  result  that 
k'^H^.  -T  (j^i)  =  0  for  i  =  1, ...  ,771  is  not  possible  for  {m  +  l)(77,„a,\-  —  1)  +  ''77/i,„ax  +  /^.  different 
values'^of  u,,  then  5,.(a;)  >  0  for  less  than  (?77  +  l)(;7,„ax  -  1  )  +  777/7„,.,x  +  values  of  to.  This 
contradicts  the  hypothesis  ot  the  first  part  of  the  theorem. 

Part  2:  We  also  prove  this  result  by  contradiction.  If  was  PE,  then  i^oo  -  0^  and  ipoo  =  VV.- 
Since  limt^oo  {‘4’  —  '4^oo)  =  0,  'd’m  would  also  be  PE.  However,  let  Nj  <  2m(i7,„„x  —  1) +  vn//,,„ax +n. 
Then,  for  all  set  of  {.s,  £  C},  v:  =  1, .  -  .  ,  Nj  .  such  that  is  well  defined,  the  rows  of  the 

matrix 


are  liricxarly  dependent  in  CW  since  the  number  of  rows  (2777(/7.„,.,x  -  i)'77/7.„,ax  +  n)  >  ^7  the 
number  of  columns.  Consequently,  il  there  are  less  than  2m(;/,„ax  —  1)  +  ''77/2,„ax  +  '7  diffeient 
values  of  CO  in  the  support  of  SrA)^  there  exists  a  vector  k  £  T'-C"- +T  k  7  0 

such  that  IAAjA  Sr[A  =  0-  ^Vs,.(0)  ^  0.  This  implies  that 

-(/>,„  is  not  PE  and  therefore  we  have  reached  a  contradiction.  In  consequence,  <;:■(/)  does  not 
converge  to  zero,  unless  the  initial  error  <^(0)  lies  exactly  in  the  null  space  of  i?y,„.(0).  D 


3.3.3  Recursive  identification  convergence  results 

The  PE  condition  was  transformed  into  a  condition  on  the  reference  input  v.  m  recursive  multi- 
variable  identification  by  de  Mathelin  k.  Bodson  [65].  For  the  sake  ot  comparison,  these  results 
are  repeated  here  with  their  extension  to  the  identification  of  pseudo-canonical  MFD’s. 

Theorem  3.4  :  Frequency  domain  conditions  for  parameter  convergence  -  Identifi¬ 
cation  of  canonical  left  MFD 

Let  the  inputs  u,  be  stationary  and  uncorrelatecl  (different  frec[uencies  in  each  input) 

1.  If,  for  all  j,  the  support  of  the  spectral  measure  of  the  j/'-th  input,  57, (ai)  contains  at  least 
n  +  R,  different  values  of  a-  then  as  /  co,  d,  0’,  and  if  it  contains  at  least  n  +  i/,„,.x 
different  \'alues  ot  to  then  as  /  — >  oo,  &  -a  0‘. 
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2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  5j/(tu)  does  not 
contain  at  least  k  different  values  of  tu,  or  if  the  support  of  the  spectral  measure  of  one 
of  the  inputs  does  not  contain  at  least  i/,-  different  values  of  tu,  then  as  t  co,  Oi  Oj 
for  almost  all  initial  conditions.  If  it  does  not  contain  at  least  n  +  mz/n,ax  different  values 
of  u,  or  if  the  support  of  the  spectral  measure  of  one  of  the  inputs  does  not  contain  at 
least  i/max  different  values  of  cu,  then  as  t  — >  cx),  6  6*  for  almost  all  initial  conditions. 

Theorem  3.5  ;  Frequency  domain  conditions  for  parameter  convergence  -  Identifi¬ 
cation  of  pseudo-canonical  left  MFD 

Let  the  inputs  n,-  be  stationary  and  uncorrelated  (different  frequencies  in  each  input) 

1.  If,  for  all  f,  the  support  of  the  spectral  measure  of  the  Lth  input,  contains  at  least 

n  +  p,„ax  different  values  of  cu  then  as  f  — +  co,  0—^0*. 

2.  If  the  support  of  the  spectral  measure  of  the  inputs  taken  altogether,  5u(u.’)  does  not 

contain  at  least  -n  +  different  values  of  w,  or  if  the  support  of  the  spectral  measure 

of  one  of  the  inputs  does  not  contain  at  least  different  values  of  then  as  /  — >  co, 

0-^0'  for  almost  all  initial  conditions. 

Remarks: 

The  proof  of  Theorem  3.4  can  be  found  in  in  de  Mathelin  &  Bodson  [65].  The  proof  of  Theorem 
3.5  can  be  easily  derived  from  the  proof  of  Theorem  3.4.  In  the  SISO  case,  the  sufficient  condi¬ 
tion  for  parameter  convergence  is  equal  to  the  necessary  condition.  As  e.x'pected,  2n  frerpiency 
components  are  necessary.  Consequently,  the  number  of  ireciuency  components  necessary  lor 
parameter  convergence  is  equal  to  the  number  of  parameters  Ng.  This  is  not  true  for  multivari¬ 
able  systems  where  less  freciuencies  are  required  than  the  number  of  parameters.^ 

Generally,  the  sufficient  condition  is  different  from  the  neces.sa.iy  condition  (it  is  equal  when 
m  =  1).  When  the  necessary  condition  is  satisfied  but  the  sufficient  condition  is  not,  parameter 
convergence  may  or  may  not  occur  depending  on  the  value  of  the.  frequency  components  in  the 
input.  This  peculiar  phenomenon  was  reported  in  de  Mathelin  &  Bodson  [65]. 

It  is  also  interesting  to  note  that  the  condition  for  the  convergence  of  0  0‘  is  identical 

in  both  cases  if  i/,uax  =  Auax-  However,  in  the  canonical  case  (with  usually  less  parameters  to 
identify),  the  convergence  of  the  parameters  of  rows  with  smaller  observability  indices  can  be 
guaranteed  by  smaller  frequency  domain  conditions. 

3.3.4  Comparison 

In  the  SISO  case,  the  sufficient  condition  for  parameter  convergence  is  equal  to  the  necessary 
condition.  As  expected  (r/.  Boyd  k  Sastry  [66]  and  Elliot  el.  ul.  [62]),  2n  frequency  components 
are  necessary  in  the  MRAC  case  (with  unknown  /q,),  and  4n  -  2  in  the  PPAC  case.  Conse¬ 
quently,  the  number  of  frequency  components  necessary  for  parameter  convergence  is  equal  to 
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the  number  of  parameters  Ne-  This  is  not  true  for  multivariable  systems  where  less  frequencies 
are  required  than  the  number  of  parameters.  Generally,  in  the  multivariable  adaptive  control 
case,  the  sufficient  condition  is  different  from  the  necessary  condition.  A  similar  result  was 
found  in  the  identification  case  by  de  Mathelin  &  Bodson  [65].  Furthermoie, 

n.c.  Ident.  (canonical)  =  n.c.  direct  MRAC  <  s.c.  direct  MRAC  <  s.c.  Ident.  (canonical) 

where  Ident.  stands  for  recursive  identification,  n.c.  for  necessary  condition,  and  s  c.  for 
sufficient  condition  summed  up  on  all  the  inputs.  A  particularly  interesting  fact  is  that  when  the 
necessary  condition  is  satisfied  but  the  sufficient  condition  is  not,  parameter  convergence  occurs 
in  certain  cases  and  not  in  others,  depending  on  the  location  of  the  frequency  components  m  the 
input.  This  peculiar  phenomenon  proper  to  multivariable  systems  is  exposed  tor  MRAC  systems 
through  examples  in  the  section  to  follow.  Furthermore,  it  will  also  be  shown  through  examples 
that  for  some  systems  and  for  some  particular  input  signals,  paiametei  convex gence  occim 
identification  case  but  not  in  the  MRAC  case,  and  vi.ee  versa.  It  is  also  interesting  to  note  that 
there  is  no  relationship  between  the  particular  frequencies  and  the  zeros  ol  the  system.  Indeed, 
there  exists  an  infinite  number  of  different  input  signals  for  which  this  particular  phenomenon 
occurs  and  it  occurs  in  the  MRAC  case  for  different  signals  than  in  the  identification  case. 

In  the  direct  PPAC  case,  the  sufficient  condition  is  equal  to  the  necessary  condition  when 

there  is  only  one  input  {m  =  1).  .Also, 

n.c.  Identification  (canonical)  =  n.c.  direct  MRAC  <  n.c.  direct  PP.AC 


and 


s.c.  direct  MRAC  <  s.c.  Identification  (canonical)  <  s.c.  direct  PPAC 

However,  the  necessary  condition  in  the  direct  PPAC  case  may  or  may  not  be  smaller  than 
the  sufficient  condition  (summed  on  all  the  inputs)  in  the  direct  MRAC  case  and  identificatimr 
case  depending  on  the  value  of  m,  n,  //.„ax  (or  p.n.ax),  Consequently,  parameter 

convergence  could  occur  in  the  direct  PPAC  case  and  not  in  the  direct  MRAC  case  or  in  the 
identification  case  and  vice  versa,  for  some  systems  and  some  particular  frequencies.  Gen«-ally, 
however,  more  frequencies  will  be  needed  for  parameter  convergence  m  the  direct  PPAC  case. 
Intuitively  this  is  to  be  expected  since  the  direct  PPAC  usually  requires  more  parameters  than 
the  other  algorithms  (twice  as  many  in  the  SISO  case).  Finally,  Table  3.2  summarizes  the 
freciuency  domain  conditions  for  parameter  convergence  for  the.  three  different  schemes  under 

study. 


3.4  Examples 
3.4.1  Robustness 

It  is  reasonable  to  ask  why  parameter  convergence  and  identifiable  parameterizations  would  be 
useful  in  adaptive  control.  The  first  reason  is  that  when  nonidentifiable  parameterizations  are 
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Algorithm 

Sufficient  condition 
(per  input) 

Necessary  condition 
(inputs  taken  altogether) 

Direct  MRAC  (A'p  known) 

n  +  -  V 

n  -b  p(r'max  -  1) 

Direct  MRAC  {Kp  known) 

^  Pma-X  P 

n  +  p(/>inax  -  1) 

Direct  MRAC  (A'p  unknown) 

n  -b  I'max  -  P  +  1 

Tt  p^inax 

Direct  MRAC  (A'p  unknown) 

^  "h  Pmax  P  ^ 

71  +  pPixxax 

Direct  PPAC 

(tTZ  -j-  l)(f^inax  1)  +  '^p-ina.x  \ 

2/7T(f/inax  1)  4~  TT^PimiX  d" 

Direct  PPAC 

(m  +  —  1)  +  TTl/Ainax  ' 

^^(/^inax  d“  ^/^niAx  d” 

Recursive  identification 

d"  ^laax 

71  ~f- 

R.ecursive  identification 

fl  -j-  Pix\ci\ 

71  “h  ^PlWFiX 

Tabic  3.2:  Conditions  for  parameter  convergence 


used  in  adaptive  control,  conditions  ot  persistency  ot  excitation  on  the  regressoi  vectois  cannot 
be  satisfied  in  general,  even  with  rich  signals,  so  that  the  parameters  will  not  converge  to  unique 
values.  Since  the  set  to  which  the  parameters  converge  is  usually  unbounded,  the  convergence 
of  the  ])a.rameters  can  be  \'ery  sensitive  to  disturbance.s.  Snrall  measuiement  noise  and  iinmod- 
eled  dynamics  can  easily  force  convergence  of  the  parameters  to  regions  ot  tlie  paiametei  space 
where  the  system  becomes  unstable.  Conversely,  with  identifiable  parameterizations  and  suffi¬ 
ciently  rich  inputs,  a  certain  degree  of  robustness  to  noise  and  unmodeled  dynamics  is  always 
guaranteed  and  the  parameters  will  remain  in  the  neighborhood  of  their  nominal  values  (c/. 

Sastry  &  Bodson  [3]).  ^ 

Another  advantage  of  identifiable  parameterizations  is  that  they  usually  require  a  smaller 
number  ot  parameters.  This  number  already  tends  to  be  large  for  MIMO  systems  and  com¬ 
putational  requirements  grow  fast  with  the  number  ot  parameters,  especially  foi  least-squaies 
algorithms.  Given  the  real-time  constraints  of  adaptive  control,  the  number  of  parameters  to 
adapt  is  therefore  a  crucial  consideration  in  practice. 

The  following  simulation  illustrates  the  fact  that  the  schemes  using  identifiable  param.eter- 
izations  generally  have  better  robustness  properties  than  those  using  nonidentifiable  parame¬ 
terizations.  This  example  is  one  of  several  simulations  that  we  lan,  adding  vaiious  types  ot 
noise  and  unmodeled  dynamics  to  the  ideal  systems.  In  our  experiments,  we  found  several 
cases  where  both  schemes  (using  identifiable  and  nonidentifiable  parameterizations)  were  sta¬ 
ble,  and  several  cases  (as  the  one  presented  here)  where  only  the  scheme  based  on  an  identifiable 
parameterization  remained  stable.  The  reverse  was  not  observed. 

Let  the  nominal  plant  be  a,  2-input  2-output  system  of  order  3,  with  the  following  transfer 
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function  matrix 


PW  = 


25^+35-4 


5^  —5  —  8 


5^+35^  -{-45+  2  5^  +3s2  +45  +  2 

—5^  —45+7  _ s+13 _ 


I  5^+352+45+2  53+352+45+2  J 

The  observability  indices  are  i/i  =  2  and  //2  =  1  ^.nd  the  canonical  left  MFD  is 

2s -1  5-31  |s2  +  s  +  4  2 

1  1 


Since 


NlM  = 


Ol{^]  = 


+  3  5-1-2 


detyV:,(5)  =  5-f2 

det  D[,{-s)  =  5'"^  -f  35'  -f  45  -1-  2  =  (5  4-  1)(5  +  2s  -f  2) 

the  system  is  stable  and  minimum  phase.  Assume  that  the  MRAC  algorithm  is  implemented 
with 

'(f  +  o  0 


A(5)  = 


(5  4- A)  0 

0  T  A) 


A  >  0 


L{s) 


0 


(f  +  1) 


>  0 


lVI{s)  =  H{s) 


0 


(^+1) 

0  ’ 


(■■•■+ 1) 


Identifiable  parameterization: 

c;  =  k:^  = 


dc,D‘  <  n,  —  i 


0  -1 

1  2 


C‘(5)  =  A(5)  -  C(5)A^l(5) 

D*(5)  -  Q{s)Dc{s)-Hs)K;^H-\.3) 


2A  2-^  A 
1-2A  -1-A 


dnC*  =  0  <  -  2 


-(1 -hA)5  +  7-3A  4- A 

(2  4-  A)5  -  10  4-  5A  -6  -f  2A 


dciD*  =  1  <  m  -  1 
dc2D*  =  0  <  //2  -  1 


Assuming  that  K,,  is  known,  the  unknown  parameter  matrix  is  given  by 


2  A  2  -)-  A  A'"^  —  2A  -j-  ^  4  A  i  A 

1-2A  -1-A  -A^-fSA-lO  -6-k2A  2  4- A 


where  the  number  of  unknown  parameter  No  =  10.  The  regressor  vector  is  defined  by 


Vp] 


vp-2  ypi 


r  “  I  /(5)(5+A)  l{s){Ux)  l{s)(s+X]  /(i)(^  +  A)  l{s) 
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Nonidentifiable  parameterization: 


dCiD'  <u  —  l=  Z/in^x  -  i 


Q  =  k;"  = 


0  -1 

1  2 


C\s)  = 
D*{s)  = 


2A  ki  2  +  A  +  ^1 
1  —  2A  k2  —  1  —  A  -f-  ^2 


dr.C*  =  0  <  1/n.ax  -  2 


-(1  +  A  +  ^'l)5  +  7  -  3A  -  3A'i  -kiS  +  4-  X-2ki 
(2  +  A  -  k2)s  -  10  +  5A  -  3A-2  -6  +  2A  -  21-2 


dc,D'  =  1  <  I/.„ax  -  1 


where  ki  and  Ao  are  arbitrary  constants.  Tlie  unknown  parameter  matrix  is  given  by 


T 

o:  = 


0 

0 


ki 

ko 


1  1  A -3  A -2  -1  -1 


and  the  regres.sor  vector  is  defined  by 


K  = 


,/,T  Ell 

l(s) 


A  siinulaxion  of  the  MRAC  algorithm  was  made  [or  botli  paraineterizatioii 
lowing  reference  input,  sufficiently  rich  to  guarantee  persistency  ol  e>:citation 


s  witli  the  lol- 
(see  Theorem 


■?  < 

'J.  1  /  , 


r,  =  sin(2  *  t)  +  sin(4  *  t) 
■02  =  sin(t)  +  sin(3  *  t) 


and  with  unmodeled  dynamics  and  high-frequency  output  noise  added  to  the  nominal  system. 
The  unmodeled  dynamics  are  on  the  first  output,  and  on  the  second  output, 

j/p,.  The  noise  is  an  additive  output  noise  equal  to  0.1sin(20  *  t)  in  the  first  output  and  equal 
to  0.1sin(2.5  *  t)  in  the  second  output.  The  unmodeled  dynamics  and  the  noise  are  more 
than  a  decade  away  from  the  dynamics  of  the  nominal  system  and  ot  the  reference  model. 
Furthermore,  the  average  amplitude  of  the  noise  is  about  5%  of  the  average  amplitude  of  the 
reference  output.  For  the  simulations,  a  ieast-.s([uares  algorithm  with  forgetting  lacior  was  use.l 
to  increase  the  speed  of  convergence.  Also,  a  stabilizing  term  was  added  to  both  schemes  (c/. 
Kreissclmeier  [69])  to  prevent  divergence  of  the  P  matrix  (which  can  occur  in  the  nonidentifiable 
paraineterizat ion ) .  The  effect  of  this  term  is  similar  to  the  resetting  but  is  easie:  to  piogiam. 
The  [larameters,  A  and  /,  were  selected  equal  to  4  and  10,  and  the  initial  controller  parameters 
were  chosen  equal  to  zero.  The  norm  of  the  output  error,  ||eoll,  is  .shown  in  Fig.  3.1  for  the 
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identifiable  parameterization  and  in  Fig.  3.2  for  the  nonidentifiable  parameterization.  Clearly, 
the  system  becomes  unstable  with  the  nonidentifiable  parameterization  and  remains  stable 
with  the  identifiable  one  (much  longer  simulations  were  run  to  verify  this  fact).  For  illustrative 
purpose,  the  estimate  parameter  Cn  is  shown  in  Fig.  3.3  in  both  cases.  We  can  see  that 
the  parameter  estimates  converge  around  stable  tuned  values  for  the  parameterization  that  is 
identifiable.  However,  the  estimates  move  out  of  the  stability  region  for  the  nonidentifiable 
parameterization. 


1  o 
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3.4.2  Parameter  convergence 


The  following  examples  illustrates  the  results  of  Table  3.2.  Let  the  plant  be  a  2-input  2-output 
system  of  order  4,  with  the  following  transfer  function  matrix 


Pis)  = 


_ 5^  -f  5  —25^—75^  —75  —  4 

^3  -j-352  _^35_^2  45^  +65^  +55  +  2 

_ 1 _  5^ +35^+35  +  1 

5'”*  +35^  +35+  2  5^ +45^ +65^  +55  +  2  _ 


The  observability  indices  are  =  2  and  1/2  —  2  and  the  canonical  left  MFD  is 


Nl{s) 


s  —2s  —  2 
1  s  -  1 


Dds) 


-f  2s  T  1  s 

s  -(-  1  s"  -f  2s  -f  2 


The  controllability  indice.s  are  //.i  =  3  and  //2  =  i  and  the  ca.nonica.1  riglit  MFD  is 


P'r{s) 


Dr{s) 


.P  -f  3.s'^  +  3s  +  2  1 

0  s  -fl 


Since 


det  Nl{s)  —  det  Nr{s)  =  +  s  -f  2 

det  Dl{s)  =  det  Dr{s)  =  s'*  +  4s'’  +  6.?'  +  5s  +  2  =  (s  +  l)(s  +  2){.P  -f-  s  -f  1) 
the  system  is  stable  and  minimum  phase. 


MRAC  case  —  A'p  unknown  ; 


Let 


A(s)  = 


(s  +  A)  0 
0  '  ( 


A  >  0  L{s)  = 


(f  +  l)  0 

0  (f-bl) 


then 


C' 


= 


M{s)  =  H{s) 


1  2 
0  1 


0 


(5  +  1) 

0  ' 


(5+1)  J 


C"(s)  =  A(s)  -  Q{s)Nr{s) 


A  -  2  4 

- 1  A  +  1 

1  t/-l  ; 


/  >  0 


D-(s)  =  (?(s)/;^(s)-A(s)A7+/-’(s) 

(3  -  A)s  +  3  -  A  (3  -  2A).5  +  4  -  2A 
s  +  i  (i  -  A)s  +  2  -  A 


dr,C‘  -  0  <  Ruuxk  -  2 


dciD'  =  1  <  n,-  —  1 
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Therefore,  the  unknown  parameter  matrix  is  given  by 


e 


.T 


1  2  A-2  4  A2-4A  +  3  2A2-5A  +  4  3-A  3-2A 

01  -1  A  +  1  1-A  A2-2A  +  2  1  1-A 


where  the  number  of  unknown  parameter  Ng  =  16.  The  regressor  vector  is  defined  by 

iT  f  (s4-i)vp,  (5+i)yp2  u,  H2  ypi  yp2  ypi.  yn. 

^  "  [  ;(5)  i(s)  l(s){s  +  \)  l(s){s  +  \)  l{s)(s-h\)  lis){s+\)  lis)  l{s)  J 

Finally,  the  conditions  for  parameter  convergence  are 

•  Sufficient  condition:  n  +  -  p  +  1  =  5  frequency  components  per  input. 

»  Necessary  condition:  ,x  =  S  frequency  components  in  the  inputs  taken  altogether. 


PPAC  case  : 
Let 


A(.s)  = 


(s  +  A)  0 

0  (,s-  +  A)(.s  +  l 


A  >  0  L{s) 


DmIs] 


r  .  1  /  .  I  ,1 

■  r  1  y  I  o  T- 


then 


r(5)  =  Ais)D:,f{s) 


0  (s  +  4) 

(s  +  A)(s  + 1)2(5  4-4) 


■(f  +  i)  0 
0  (f4-l) 

d(i,{s)  =  II, 


i  >  n 


“  ...  ,  1 

(.S'  4-  A)(.s  4-  lyT^s  +  4)  j 


-0.5  0.5 

0.5  -0.5 

0.5.S  +  1  0.5.S  4-  2 

-0.5.S  -  I  -0.5.S  -  1 


dr,\‘2  =  0  <  z/„ 


= 

C-(.s)  =  A(s)  -  Qis)Nris)  -  Ais)D^,is)V^{s)  = 


dcJJl  =  1  <  //,  -  1 


c-  ^  I-r.[D 


R  - 


0  0 
0  0 


—  3A  6A  —  6 

0  -3.T  .-  (3A  -I  3).s  --  3.\  J 

dc,C-  =  {0,2}  <  {//,.,•, X  -  /'.  +  'An.xx  -  2} 

dr'iC*  =  {0,2}  <  {//.,, i,.»x  “  +  '''iimx  1} 


/)‘(.s)  =  Q[s)Dl[s)-  A{.‘s)Dm[s)UI{s) 

"  (3A  -  3).s  4-  3A  -  3  .s  +  4A  ' 


dciD‘  =  1  <  Ri  —  1 
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The  unknown  paraineter  matrix  is 


e 


-3A  6A  -  6  0  OH  3A  -  3  4A  3A  -  3 

0  -3A  -3A-  3  -3  0  0  0 

1  -0.5  0.5  1  2  0.5  0.5 

0  0.5  -0.5  -1  -1  -0.5  -0.5 


where  (*)  means  that  the  parameter  is  always  equal  to  zero  for  all  systems  of  order  4,  with 
observabilit}'  index  2  and  controllability  indices  {3, 1}.  Consequently,  Ng  =  2l. 

iT  r  111  u->  Sti2 _  ypi  ^P2 

V  -  [  /(^h(5)  l(s)^[s)  l{s)-y(s)  l{s)'y{s)  /(sh(5)  /(5h(5) 

^Vpx  ^yp2  yp\  yp2  ^ypi  ^yp2 

I(7hC)  '(^h(5)  '(*)  '(^)  '(*)  '(5)  '(i)  . 


Finally,  the  conditions  for  parameter  convergence  are 

.  Sufficient  condition:  (m +  !)(;/, „ax  -  1)  +  + /'•.•  =  12  frequency  components  in  input 

1  and  10  in  input  2. 

•  Necessary  condition:  2-m(//...aK  -  1)  +  +  n  =  14  frequency  components  in  the  inputs 

taken  altogether. 


Identification 

case  : 

Let 

Lis)  = 

_  [  ^ 

^  [ 

-j-  /j.S  +  /q 
0 

■S' 

0 

+  L' 

?  d"  fo 

L,/u>n 

Then, 

'  0  - 

2  1  -2 

/o 

- 1 

0 

1,-2  -1 

0  = 

1  - 

■1  0  1 

-1 

lo-2 

-1  h-2 

Jj  - 

iH2. 

Vpx 

VPI 

svpi  ^yp-2  ] 

V  - 

.  '(d 

l{.)  /(.•) 

/(.) 

l{s) 

l{s) 

l(s)  J 

Therefore,  Ng  =  16.  The  conditions  for  parameter  convergence  are 


Sufficient  condition:  n  +  j/„,ax  =  6  frequency  component.s  per  input. 
Necessary  condition:  vH- 'mry.ax  =  S  frequency  components  in  the  inpurs 


taken,  altogether. 


To  illustrate  the  re.su!t.s,  it  is  convenient  to  compute  the  smallest  eigenvalue  of  (direct 

adaptive  control)  or  R,i,[Q)  (identification),  dins  number  is  0  it  a.nd  ly  aio  1  E  and  —  0 
otherwise.  Table  3  summarizes  the  results  obtained  by  computing  /rv,,,.(0)  or  /?y(0)  lor  several 
inputs.  Case  number  1,2,  3, 4,  and  5,  with  4  frequency  components  (f.c.)  in  both  inputs  shows 
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Case 

Inputs 

nbr. 

f.c. 

A.nin(i?v,^(0)  or  Rv,(0j) 

MRAC 

PPAC 

Ident. 

1 

Tj  =  sin(2.0i)  +  sin(4.0£) 
r2  =  sin(1.0£)  +  sm(3.0£) 

4 

4 

4  0 

0 

40 

2 

Ti  =  sin(2.0£)  +  sin(l. 197824110 

7-2  =  sin(1.00  +  siri(3.0£) 

4 

4 

0 

0 

40 

3 

T'l  =  sin(2.00  +  an(0.8851S347£) 

72  =  siii(1.0i)  +  sm(3.0£) 

4 

4 

40 

0 

0 

4 

Ti  —  sin(1.00  +  sm(3.0£) 

7-2  =  sin(2.0£)  +  sm(1.197S2411£) 

4 

4 

0 

0 

40 

.5 

7*1  sin(l.O^)  +  sio(3.0i!) 

7*2  ==  sin(2.0^)  +  sia(0-8S518347i) 

4 

4 

40 

0 

40 

G 

7-1  =  siii(0.5773.50270  Tsiu(l. 53741222/.) 

7'2  —  1 .0  T  sinO'flO  "b  siti(3 .0/ ) 

4 

5 

7^  0 

0 

0 

7 

Ti  =  sin(2.0i) 

7-2  =  siu(l.O^)  +  ^^s.(3a07) -r  sin(5.0/) 

2 

G 

0 

0 

40 

8 

/•i  =  1.0  +  siu(2.00 
r>  =  sinfl.O/.) +si3s{3.0/) 

3 

4 

0 

0 

0 

9 

■r,  =  sin(0.5/)  4-si<2.0/]  +  sir.'  LO/)  +  sin(5.0/) 
7-2  ==  sin(0.2/)  +  silifl.O/) -f  siui'o.O/) 

8 

6 

4  0 

40 

4  0 

1 

1 

- 1 

10 

r,  =  1.0  +  sin(0..5£)-r  siii(2.b/'i  -  sinf4.0/,) 

12  —  siu(0.2/)  -f  siidi.O/ i  -f-  sui.ps.Oi) 

7 

G 

40 

0 

#0  1 

i 

11 

vi  =  siTi(0.5t)  -f  siii!  4.00  +  sin(5-0i) 

/'o  =  1 . 0  -p  1  -Oi f  "T  ( 3 . 0 1 1 

8 

5 

4  0  j 

1 

0  j  AO 

1 

Table  3.3:  Simulation  results 


that  when  the  necessary  condition  is  respected  but  the  sufficient  is  not  in  the  MR  AC  case  and 
in  the  identification  case,  parameter  conr'ergence  will  depend  on  the  location  ot  the  f.c.  in  the 
input.  In  case  1  there  is  parameter  convergence  in  the  MRAC  case  and  in  the  identification 
case.  In  case  2.  the  parameters  converge  to  their  true  values  for  the  identification  scheme  but 
not  for  the  MRAC  scheme,  while  in  case  3.  it  is  just  the  opposite.  It  was  found  that  there  e.xists 
an  infinite  number  of  values  for  the  f.c.  such  that  convergence  does  not  occur,  so  that  those 
values  are  not  related  in  any  obvioius  manner  t,o  tiie  zero.s  of  the  system.  Ca.se  h  and  case  •:) 
correspond  to  case  2  and  case  3  when  the  two  injiuts  are  permuted.  We  can  see  that  it  has  no 
effect  in  the  MRAC  case,  but  that  it  changes  the  convergence  properties  in  the  identification 


case.  This  is  due  to  the  syininetry  of  the  model  in  the  MRAC  case.  Case  6  with  5  f.c.  in  input 
1  and  4  f.c.  in  input  2,  illustrates  also  that  convergence  occurs  iu  some  cases  and  not  in  others 
when  the  sufficient  condition  is  not  satisfied.  In  case  6,  there  are  more  f.c.  than  in  case  1,  but 
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the  identification  scheme  will  not  allow  convergence  of  all  the  estimates  to  their  true  values. 
Case  7,  shows  that  with  a  minimum  of  2  f.c.  in  one  input,  parameter  convergence  might  still 
occur  in  the  identification  case  when  the  necessary  condition  is  respected.  On  the  other  hand, 
case  8  illustrates  that  8  f.c.  in  the  whole  input  are  absolutely  necessary  to  have  convergence  in 
the  identification  and  the  MRAC  case.  Case  9,10  and  11  illustrates  that  14  f.c.  in  the  inputs 
taken  altogether  is  a  necessary  condition  for  parameter  convergence  in  the  PPAC  case. 

We  also  simulated  the  behavior  of  the  algorithms  under  these  different  inputs.  To  increase 
the  speed  of  convergence,  a  least-squares  algorithm  with  forgetting  factor  was  used  for  the 
simulation.  Fig.  3.4  shows  the  evolution  of  the  function  v{t)  =  ln||(^l  —  for  the  direct 
MRAC  scheme  in  case  1,  2,  and  3.  Fig.  3.5  shows  the  evolution  of  the  function  v{t)  for 
the  recursive  identifier  in  case  1,  2,  and  3.  Since  0  0‘  exponentially  when  i’  is  PE,  the 

asymptotic  behavior  of  n(/.)  in  the  identification  case  reflects  the  rate  of  conv'ergence  of  the 
algorithm.  When  the  input  is  not  PE  all  the  estimates  do  not  converge  to  their  true  value,  and 
=  'n(oo)  — oo. 

It  is  also  interesting  to  see  how  the  output  of  the  system  ijj,  converges  toward  the  reference 
output  ijrn-  Fig.  3.6  shows  the  signal  e{t)  =  In  ||(y/,,  -  v/,„)||  with  the  signal  v{t),  in  case  1,  for 
the  MR.4C  scheme.  Note  how  the  output  converges  at  the  same  rate  a..s  the  parameters. 


SO 


Chapter  4 

A  transformation  to  avoid  singularity 
regions 


4.0  Introduction 


in  the  previous  chtipters,  SISO  ftclaptive  control  (KIR.AC)  lesults  have  been  extended 
, liable  syst.ems  b.y  several  authors,  c.g.,  Goodwin  k  Long  [20],  Elliot  k  Wolovich 


As  shown  in 
to  multivari 

[6,  11],  Singh  &  Narendra  [9,  10],  Dugard  et  ul.  [12],  Ortega  et  al.  [14],  Das  [7],  Johansson 
[13],  D'ion  et  al.  [50],  and  Tao  .G  loaiinou  [S],  Unfortunately,  similarly  to  some  SISO  algorithms 
requiring  the  knowledge  of  the  sign  of  the  high-frequency  gain,  current  MIMO  algorithms  require 
significant  a  prion  knowledge  or  cousirainis  on  the  high-frequency  gain  matrix,  nithei  tue  hign- 
frequency  gain  matrix,  /C.  must  be  known  (fully  or  partially,  e.g.,  Kj,  diagonal  with  the  signs 
of  the  diagonal  elements  known),  or  it  must  satisfy  some  positive  definiteness  condition  (e.y., 
there  exists  a  known  matrix  S  such  that  Sl\p  -f  (SKp)^  >  0).  Another  unrealistic  alternative 
is  to  require  that  the  initial  parameter  error  be  sufficiently  small  so  that  singularity  regions  are 
avoided  (c/.  Theorem  2.2).  Note  that  the  discrete-time  algorithms  presented  in  Goodwin  k 
Long  [20]  and  in  Dugard  et  al.  [12]  do  not  explicitly  require  the  knowledge  of  the  time  delay 
gain^^matrix.  In  their  algorithms  the  identifier  is  modified,  following  Lemma  9.1  in  Goodwin  et 
al.  [19],  to  avoid  singularity  of  the  estimate  of  the  time  delay  gain  matrix.  This  is  necessary 
because  its  inverse  must  be  computed  in  the  implementation  of  the  control  law  (similarly  to 
control  law  (2.3)).  However,  even  if  their  modification  is  implemented,  the  estimate  ol  the  time 
delay  gain  matrix  may  still  converge  arfiitrarily  close  to  singularity  it  the  regressor  vector  is 


not  sufficicnth.'  c.xciting.  Tlicrcioi 


if  it  can  be  proved  in  theory  th.';'  tie'  centre!  sign-el 
■a  is  bounded,  in  practice,  a  will  not  lie  computable  when  the  estimate  ol  the  time  delay  gain 
matrix  converges  close  to  singularity.  Furthermore,  this  modification  cannot  be  a.dapted  to 
continuous-time  systems.  Thcrefoie,  for  all  practical  purposes,  knowledge  of  the  tunc  delay 
gain  matrix  or  the  high-frequency  gain  matrix  must  be  assumed. 


In  the  SISO  case,  the  luoblem  of  relaxing  the  reciuirement  of  knowledge  of  the  s 


ign  ol  the 
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high-frequency  gain  was  first  solved  by  using  controllers  based  on  the  so-called  Nussbaum  gain, 
cf.  Mudgett  &  Morse  [70,  71],  Morse  [72],  and  Lee  k  Narendra  [73].  Because  of  the  limited 
practical  use  of  these  controllers,  Lozano  et  al.  [74]  proposed  a  completel}''  different  approach. 
In  their  algorithm,  the  controller  parameters  are  obtained  from  the  estimated  parameters  by 
applying  a  transformation  with  a  sort  of  hysteresis.  More  specifically,  the  transformation  is 
the  identity  when  the  estimate  of  the  inverse  of  the  high-frequency  gain  is  different  from  zero. 
When  the  estimate  becomes  too  close  to  zero,  the  algorithm  freezes  the  controller  gain  until  the 
estimated  gain  becomes  large  enough.  Then,  the  transformation  becomes  the  identity  again 
and  the  controller  parameters  are  set  to  be  equal  to  the  estimated  parameters.  A  hysteresis 
guarantees  that  switching  instants  are  separated  by  finite  time  intervals.  It  is  worth  noticing 
that  a  SISO  hysteresis  switching  controller  solving  the  problem  of  unknown  relative  degree  and 
unknown  high-frec[uency  gain  ha.s  also  recently  been  presented  by  Morse  ct  al.  [75]. 

In  the  MIMO  case,  the  problem  of  unknown  high-frequency  gain  matrix  is  even  more  dif¬ 
ficult.  The  Nussbaum  gain  approach  is  not  directly  applicable  to  MLMO  MR.AC  algorithms. 
However,  using  the  hysteresis  idea  of  Lozano  cl  al.  [74]  with  some  very  significant  modifications, 
we  show  ill  this  chapter  how  to  design  a  MIMO  MRAC  algorithm  so  that  stability  is  guaranteed 
even  if  the  high-frequency  gain  matrix  is  unknown  (only  an  upjier  bound  on  the  norm  ol  the 
liigh-liequcncy  gain  matrix  a.nd  an  upper  bound  on  the  norm  of  the  matri.x  of  unknown  param¬ 
eters  are  needed).  VVT  show  that  all  the  signals  in  the  system  remain  bounded,  that  the  output 
error  conv'erges  to  zero,  and  that  the  regressor  error  is  in  L'l  and  converges  to  zeio,  indepen¬ 
dently  of  the  richness  of  the  signals  used  as  reference  inputs.  We  also  prove  that  exponential 
convergence  is  acliieved  when  persistency  ol  excitation  conditions  aie  mco.  Aside  fiom  the 
nontrivial  multivariable  extensions,  an  original  contribution  of  this  chapter  are  the  exponential 
convergence  result  (only  a.symj3totic  stability  is  achieved  by  Lozano  ct  al.  [/4]  algoiithm).  Oui 
success  in  applying  the  hysteresis  transformation  also  suggests  tha.t  such  transformation  may 
prove  helpful  to  solve,  other  prolDlems  where  singularity  regions  must  be  avoided,  such  as  in 
adaptive  pole  placement,  and  in  nonlinear  control  using  linearization  techniques.  An  adaptive 
pole-placement  SISO  algorithm  using  the  hysteresis  transformation  has  just  recently  been  pie- 
sented  by  Lozano  [76].  Finally,  note  that  an  earlier  version  of  the  hysteresis  transformation  was 
applied  to  a  MIMO  MRAC  algorithm  in  de  Mathelin  &  Bodson  [77]. 


4.1  Preliminaries 

This  section  presents  definitions  and  properties  from  matrix  computation  theory.  VVliile  most 
definitions  are  sta.ndard;  many  tacts  reviewed  here  are  not  so  well-known  and  will  be  used  in 
the  sequel.  For  more  details  about  matrix  computation  theory,  tlie  reader  is  referred  to  the 
liooks  lyy  Stewart  [78],  Stewart  k  Sun  [79],  and  Golub  k.  Van  Loan  [bO]. 


Definition  4.1  ;  Norms 


If  x  is  a  vector,  possibly  function  of  time,  then  (c/.  Desoer  &  Vidyasagar  [81],  Chapter  II),  we 
denote 

1.  \x{t)\  the  Euclidean  norm  of  x  at  time  t. 

2-  blip  =  [/o“  |x(r)|Pdr]^/p  for  p  G  [l,oo) 

3.  blleo  =  supo<(  |x(i;)| 

4.  ||.xy||p-[;o'|-bOI"^^]^^"foi-pe[l,co) 

h-  j|x^|joo  ^^^Po<T<i  l‘^(^  )l 

and  we  say  that  x  G  L„  wlien  |lx||,  exists,  that  x  G  L,t  when  l|x,||p  exists  for  some  /  >  0,  and 
that  x  G  Lj,e  when  ||■■^•■i||p  exists  for  all  f  <  co. 

If  /I  is  a  matrix,  possibly  function  of  time,  then  ||A||f  will  be  the  Frobeiiius  norm  of  .4  and 
|A|,  IIAljp,  IIAllc..,  ||Ai|l;,,  llAtIloo,  will  be  the  induced  norms  of  A.  For  example; 

|A|  =  sup  jAxj 
1-4=1 


Definition  4.2  :  Projections 

Following  Stewart  k  Sun  [79],  Chapter  I,  let  A’  be  a  .subspace  of  of  dimension  r  <  n  and 
let  the  columns  of  the  orthogonal  matrix  Qx  t  form  an  ortlronormal  basis  for  A',  with 

Q\-Qx  =  I-  A"he  matrix 

P.y  -  QxQ'x 


defines  the  orthogonal  projection  onto  .W  re.  Vx  G  fR",  Pxx  G  A'  and  (x  -  Pxx)  1  Ah  It^  can 
be  easily  verified  that  the  matrix  Px  G  is  symmetric,  idempotent,  and  independent  of  the 


choice  of  Qx-  The  matrix 


=  I  -  P,v 


defines  the  orthogonal  projection  onto  A'^,  the  subspace  of  of  dimension  n  -  r,  that  is 


the 


ortho^onLcil  conipleiTiciit  oi  -  The  nie.tiix 


e 


is  also  symmetric,  idempotent,  and 


independent  of  the  specific  choice  of 

Let  TZ(A)  be  the  range  of  A,  i.e.  the  subspace  of  spanned  by  the  columns  of  the  matrix 

A.  Then,  there  always  exists  a  square  orthogonal  matrix  U  such  that  AIJ  = 
full  rank  and  one  has  that 


B  0 


with  B 


gn(,.i,  =  BiB^ny 


n 


4  -KiA) 


Of  pmi 


Definition  4.3  :  Singular  value  decomposition 

Let  A  G  have  rank  r.  then  the  singulai-  value  dccoinposition  oj  A  is  given  by  (ct.  Stewait 

k  Sun  [79],  Chapter  I) 

U^AV  lAU  =  I  = 
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where  the  matrices  U  G  V  e  and  E  =  diag{cr.-}  with 

0*1  ^  (72  ^  •  •  •  ^  ^  <^r  +  l  =  .  .  .  =  ^irun(Tn,n)  ^ 

The  matrix  of  singular  values,  2,  is  uniquely  defined,  but  the  matrices  of  singular  vectors  U 
and  r  are  not.  However,  if  U’  and  H'  are  another  set  of  such  matrrces,  then  It  can  be  shown 
that  there  exdsts  an  orthogonal  matrix  W  €  that 

[/*  =r  l/lV  V‘  =  VW  WT.W'^  =  £ 

This  implies  that  UU^\  VV^  and  UV^  are  invariant.  Now,  assuming  that  there  are  q  distinct 
singular  values  cxr  >  a,*  >  .  .  ■  >  a;  >  0,  with  multiplicity  /f.;  (ELi  M  -  r),  a  further  result 

IS  that  ^  Q 

IT  =  block  diagonal 


0 


1T„ 


where  the  matrices  Hh  G  are  orthogonal  matrices.  Then, 

[ 

r./i  ...  u\,]\a[\\  ...  e]  = 

0 


is  a  partioned  singular  value  decomposition  of  x4,  where  £;  =  G  and  the 

products  6',T7,  V;Vf,  and  (/.Vy,  i  =  1,...,^  are  again  unique,  despite  the  fact  rh.at  tru 

niatnces  (A-,  V;  are  not.  ^  _  .  ,  •  ^  i  > 

Fiiiallv  let  4  and  A  +  AA  be  matrices  of  same  dimensions  with  smgulai  values  <7,  og  _ 

>  T-d  >  o.  +  fior  >  .  . .  >  Ur  +  iu,.  Then,  it  can  bo  shown  (sec  Stewart  &  Sun 

[79],  Theorem  IV  4.11,  pp.  204-205,  (by  Mirsky))  that 

Ijdiag  {^0'.}  II  <  |72l|| 

for  any  unitarily  invariant  norm  |1.|1  (e.^..  the  Frobenius  norm  and  the  induced  Euclidean  norm). 
Consequently,  the  singular  values  of  A  are  continuous  in  the  elements  ol  A. 

Lemma  4.1  ;  Continuity  of  subspaces  spanned  by  singular  vectors 

Let 

[  f/,  (A  1  A  f  A  I- 


Ig  1  - 

■  El 

0 

0 

of  A,  wi 

thout  any 

r  . 

which  the  singular  values  appear.  Let 

[  f/i  +  (S'Ci  La  +  ‘Va  '  i  1  ^ 

be  a  conformally  partitioned  singular  value  decomposition  of  A  +  6 A. 


Si  H"  (^Si  0 

0  S2  "h  <^^2 


S7 


1.  Suppose  that  3  A  >  0  such  that  min(|(T.(Ei +(^Si )  - o-j(E2)|)  >  A,  V  i,j,  and  min(o-.-(E:  + 
^Ei))  >  A,  Vz.  Then 


iWPni^Ui)  -  Pn{U,+su,)\\'F  +  II-Ptc(Vi)  ~  ^  ^ 

where  A^i  =  size  of  S;. 


2.  Suppose  that  3  A,  P  >  0  such  that  min(<Ti(Ei  +dEi))  >  r  + A,  V  z,  and  max(cr,-(E2))  A  P? 

|^4| 

niax{|P7;(t/,)  -  PT.{U,+sUi)\,\Pnv,)  -  ^^(^+^^1)1}  < 


These  results,  [n'esented  under  a  different  form,  are  due  to  VVedin  and  can  be  found  in  Stewart  & 
Sun  [79]  as  Theorem  V  4.1,  pp.  260-262  and  Theorem  V  4.4,  pp.  262.  The  form  presented  here 
is  obtained  by  applying  to  VVedin’s  results  the  properties  o{  the  Frobenius  norm  and  Theorem 
I  5.5,  pp.  43-44,  in  Stewart  A  Sun  [79]. 


4.2  Hysteresis  transformation 

Although  it  might  not  lie  obvious  (l  prion,  the  development  ot  a  stability  proof  for  the  MRA(.y 
algorithm  reveals  that  the  [laramcter  Co  in  the  control  la.w  (2.1)  must  be  nonsingular.  More 
precisely,  the  matrix  6',7'  must  remain  bounded.  Since  this  property  is  not  guaranteed  by  the 
parameter  idciitification  algorithm  (2.29),  the  jiaramctci  Ay  used  m  the  comiOi  hiw  wnl  be 
dissociated  from  the  estimate  Co-  Herea,fter,  we  will  use  tne  subscript.,  c.  to  mark  liie  controller 
parameters,  as  opposed  to  the  estimated  parameters.  So,  instead  oi  (.-’o,,  being  equal  to  the 
estimate  Co,  a  transformation  is  applied  to  make,  sure  that  Co,  has  a  bounded  inverse  even  if 
Co  is  close  to  siugularily.  In  the  SISO  case,  such  a  parameter  transformation  algorithm  was 
introduced  by  Lozano  ei  al.  [74].  In  this  paper,  we  propose  a  similar  mechanism  for  the  MIMO 
case,  which  enables  us  to  prove  stabilit}^  However,  some  important  modifications  must  be  ma.de 
to  the  original  SISO  transformation  to  make  it  applicable  to  the  MIMO  case. 


4.2.1  Assumptions 

To  implement  the  parameter  transformation,  we  will  assume,  that  an  upper  bound  of  the  norm 
of  the  hi^'h-frennenev  gain  matrix.  =  CC-  .  and  that  an  upper  bound  of  Id  I  is  known. 


4.2.2  Necessary  properties 

To  complete  the  proof  of  stability  and  convergence  of  the  MR.AC  algorithm,  one  huds  that  the 
following  properties  are  required  from  the  parameter  transformation: 
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1.  a;  €  L 


2.  G  L^. 

3-  Pc  =  T+gt  €  L2  n  where  4>c^6,-  G\ 

4.  If  limi_oo  P{^)  —  0  then  lim;_oo  Pc{i)  —  0- 

5.  If  P{t)  and  (f>{t)  converge  to  sonre  Poo  and  4>^  then  4>c{i)  converges  to  some 

Since  the  transformation  that  we  propose  to  achieve  this  objective  is  complex,  we  proceed  to 
present  the  transformation  in  several  steps. 

4.2.3  Transformation  I  :  simple  hysteresis 

Define  Cq.(J)  a.s  being  equal  to  Co(0  when  a^r,{Co)  is  sufficiently  large,  and  staying  constant 
when  (T^l{Co)  becomes  too  small  (a^n  denotes  the  smallest  singular  value).  More  precisely, 
since  an  upper  bound  on  |/vp|  is  known,  a  lower  bound,  cr,  on  (7min(Co),  is  also  known. 
f7min(Co(0))  >  a,  and  define  Cq,  such  that  the  relationship  between  crn^n(Co^)  and  (J„,;„(C;o)  can 
brdescribed  by  Fig.  4.1.  Define  {4}  as  the  time  instants  when  the  value  of  Co,  becomes  frozen 


Figure  4.1;  ^min  (Co,) 

and  {Tk}  as  the  time  instants  when  a  jump  in  the  value  of  Co,  occurs  (when  Co,  is  unfrozen 
and  becomes  equal  to  Co  again).  The  levels  at  which  freezing  and  unfreezing  occur  are  chosen 
to  be  different  to  prevent  repeated  switchings  arbitrarily  closely. 


S') 


Precisely  stated,  we  let  o‘iniii(C'o(0))  ^  o',  To  —  0,  and  V  /c  >  1 


is  such  that 
Tk  is  such  that 


^inin(^o(^fc))  Ct/6 

O-.nii.(C'o(0)  >  <  ^-  <tk 

O-miniCoiTk))  =  O-ja 
crmin(C'o(t))  <  crja  \/  tk  <  t  <  Tk 


(4.1) 


In  Fig.  4.1,  the  parameters  a  and  b  are  respectively  equal  to  2  and  4,  but  other  values  can  be 
selected,  provided  that  1  <  a  <  b  <  oo. 

Note  that,  since  Co(/)  is  continuous,  tk  <  Tk  <  tk+i  <  Tk+i  VA;  >  1  and 


0'„ur,(Co(0)  >  if  <  i  <  tk 

(Omiu{Co{t))  <  O-jd  if  tk<t<Tk 


The  relationship  between  Coj{t)  and  Co{t)  is  described  by 


CA)(t)  d  Tk-i  <  /  <  /-k 

C'u(/k)  if  tk  <  t  <  Tk 


so  that  (7„,i„(6’o,(0)  >  Ok jb  V  t. 

The  following  paianuilei  Ira.nsloiHiation 


Ch,_  =  Co, 

C,^  =  C,  2  =  1,...,//-! 

id,,  =  D,  7  =  1,...,;/ 


(4.2) 


(4.3) 


would  then  appear  to  be  adec[uate  at  tliis  stage.  Hov/evei',  it  can  be  cb.ecked  that  the  trans¬ 
formation  (4.3)  does  not  guarantee  property  3  of  section  4.2.2,  although  it  guarairtees  all  the 
others.  Therefore,  the  following  additional  transformation  is  necessary. 


4.2.4  Transformation  II  :  simple  hysteresis  -f  projection 

To  solve  the  problem  of  guaranteeing  property  3,  the  matrices  and  {/),;)  in  the  controller 

are  also  transformed,  using  the  following  parameter  transformation 

{  0[ij  ii  'j k-i  ^  ‘  <  'k  >  0 

0c{t)  =  \  (4-4) 

[  d(c  +  P(0C,,I0(gf(0T(/))-’(C,?;(/)-Cj'(/))  if  fk<t<Tk  VA->0 

where  Pp  is  the  rectangular  matri.x  made  ol  the  first  p  columns  of  the  covariamce  matri.x  P  [cj. 
Section  2.4).  Since  P  i.s  symmetric,  P'^  is  the  matrix  made  of  the  hrst  p  rows  of  P.  It  can  be 
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checked  that,  with  this  transformation,  Co,  =  Co^.  Further,  the  transformation  is  well-defined 
and  all  the  necessary  properties  of  section  4.2.2  are  guaranteed  as  long  as 

3c>0  s.t.  yh<t<T,  (4.5) 

In  the  SISO  case,  it  can  be  proved  that  condition  (4.5)  is  always  satisfied,  so  that  the  parameter 
transformation  (4.4)  is  always  well-defined  (it  is  the  transformation  presented  in  Lozano  d 
al.  [74]).  Indeed,  given  the  least-squares  estimation  algorithm  (2.29),  ^(^"V)  =  0  between 
resettings,  from  which  one  can  deduce  that 

Kq 

where  is  the  last  covariance  resetting  time  instant,  i.c.  Tj  <  t  <  Iheiefore, 

A.q 

In  the  SISO  case,  Pp  is  a  vector.  Based  on  (4.7),  if  for  some  t  >  0,  |P ,,(01  <  ^(^  " 
then  the  scalar  Co(0  is  such  that  |Co(01  >  and  3k  >  I  such  that  <  t  <  C-  Therefore, 
_  Co(0'  In  words,  this  says  that  if  1],  was  to  be  small  enough,  it  would  mean  that  there 
had  been  sufficient  excitation  to  identify  Co  accuratcl\-  enough  and  the  algorithm  would  be  out 
of  the  .singuharity  region  (first  part  of  (4.4)). 


Unfortunatelv.  in  the  MIMO  case,  there  is  no  guarantee  that  condition  (4.5)  is  respected 
V  t  >  0.  Indeetl,  if  there  i.s  excitation  in  some  directions  but  not.  otlier.s,  u„,i„(Pp(/))  could  tend 
to  zero  while  al,,PP,,(0)  '^'ould  not.  Therefore,  one  could  conceive  tha.t,  given  certain  imtial 
conditions  and  given  certain  reference  signals,  lim;_c.,  u„„„(Pp(/.))  =  0  with  linp-co  o-i.m.(Co(0) 
<  a/ll.  In  that  case,  the  transformation  (4.4)  would  not  be  well-defined  V  t  >  0.  Therefore, 
property  2  of  section  4.2.2  would  noc  be  guaranteed  for  this  transformation  in  the  MIMO  case. 


4.2.5  Transformation  III  :  selective  hysteresis  +  projection 

To  solve  the  problem  of  the  pseudo-inverse  Pp(PjPp)-'  not  being  necessarily  bounded  in  the 
MIMO  case,  an  additional  modification  is  brought  to  the  parameter  transformation.  Essentially, 
the  problem  is  that  if  the  estimated  matrix  Co  persists  in  being  singular,  despite  the  presence 
of  excitation  in  certain  (but  obviously  not  all)  channels,  then  the  matrix  Co„  must  be  updated 
ip  t),p  rlirectioms  wliere  there  is  excitation.  The  major  challenge  is  to  achieve  this 
objective  while  maintaining  the  boundedness  of  Cy/  and  the  properties  listed  in  section  4.2.2. 
VVe  consider  the  tollowing  translorination 


Oil) 


0c{t)  = 


o{t)  +  -  cjin) 


Tk-i<t<ik  VA->0 
t,  <  i  <  Tk  VL  >  0 


(4,8) 
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where  YpT^p^Uj  is  a  lower  rank  approximation  of  Pp[Pj Specifically,  we  consider  the 
following  partioned  singular  value  decomposition  of 


\T  rr 

r  ^  _  1  1 

■  Ep  o' 

'Up  u/ 

1 

II 

_  0  E,  _ 

such  that 


Sp  — 


diag  {o-,  }  cTi  >  cry  Y  i  <  j 


(7i  0  .  0 

0  <72  . 

0  .  0  cr,Y^  J 

O'Np  +  i  0 


>  {o'Pp+\+Sp)I  >  {ep  +  Sp)I 


0 


(7,,_i  0 

0  (7,, 


(4.9) 


cp-f-jp  Ap  l)<^p  0 

- 

0  ■ 

< 

cp  +  6p 

0 

0 

0 

^p  . 

<  {ep  +  {i>-  Np-l)8p)I  (4.10) 

Np  i.s  the  size  of  "Pp  and,  therefore.  Up  G  ,  Vp  G  ,  b(  G  ^  and  \v  G 

sp27»'x(p-.Vp)_  constants  cp  and  8p  are  arbitrarily  chosen,  but  must  .satisfy  the  following 

conditions 


0 

0 


<  Cp  <  (1  —  1/ci)  — 


(p-l)/ar)(a,.  y  K;(0)i) 


<  <f/ 


Cp/  ap 


with  Qp  >  1 


(4.11) 


where  cr^;.  i.s  a  known  upper  bound  of  \0  j.  Basically,  contains  the  singular  values  of  P^ 
no  greater  than  ep  and  the  ones  which  are  sufficiently  close  to  them  (by  increment  bp).  Ep 
contains  the  larger  singular  values  such  that  <7,„i,,(Ep)  >  <7,„,-ix(Ef)  +  bp.  1  he  difterence  bp  is 
found  to  be  required  to  guarantee  continuity  in  the  proof. 

Finally,  P.p  =  VjUq  ,  where  Vj  is  an  orthonormal  basis  of  the  subspace  X  =  TZ{CojVpUp) 
of  size  Np  and  Uo  is  an  orthonormal  basis  of  the  subspace  3^’  =  TZ{C(}UtUj)^  also  of  size  Np. 
Therefore,  given  the  properties  of  projections  (c/.  Definition  4.2) 


Vj  Vj  =  I  and 
ly  Uo  =  I  and 


VfVl  =  Pnc.,upur,  ^  P,  G  3?-^' 


A 


b'cib'o  —  P n[c,,!puT)  ~ 


^  Pv  e 


(4.12) 


If  o-.,m.(Pp^'(0)  >  then  Np  =  p,  and  Px  =  Py  =  1.  If  <7.,.i„(P/'(0)  <  Hien  Np  <  p  and  Px 
and  Py  are  given  by 

Px  —  Co  j  U  p  ( b  p  6 1,  C  0  J  U  p )  '  Up  C  u  ^ 

Py  =  (/ —  C'ab''f(bJ  C-’o  ('’ofy)  Co)  (■I-l-^) 
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Indeed,  referring  to  Definition  4.2,  we  let  A  —  CojUpUf  and  U  —  [  Up  Dt  ],  so  that  B  Co^Up 
and  Px  is  given  by  (4.13).  This  assumes  that  B  =  CojUp  has  full  column  rank,  i.e.,  U pC^^CojUp 
nonsingular.  How'ever,  since  Cqj  is  nonsingular,  (DpC^Co^Dp)  ^  is  well-defined  and  the  number 
of  columns  of  V}  is  equal  to  Np.  A  similar  derivation  applies  for  Py.  From  (4.6),  it  can  be 
checked  that 


ulcl(t)  =  vjc-j  +  ujpj(t)^  =  vjcf  + 


(4.14) 

Kq  ^0 

where  is  the  last  covariance  resetting  time  instant,  i.e.  tj  <  t  <  r^+i.  Therefore,  given  (4.10) 
and  (4.11) 

crnUUjC^)  >  c-  -  (ep  -f  (p  -  Np  -  l)dp)^^  >  cxia  (4.15) 


so  that  [UJCqCoUcY^  is  well-defined  and  the  number  of  columns  of  Uo  is  indeed  equal  to  Np. 
Comments; 

To  guarantee  some  continuity  properties  and  the  uniqueness  of  Vf  and  Du,  the  Gram-Schmidt 
orthogonalization  procedure  with  memory  described  in  the  appendi.x  is  applied  to  Px  and  Py 
to  compute  Vj  and  Uo  respectively.  Using  this  procedure,  we  also  have  that  it  o-,„i„(Pyf (/.))  > 
cp  then  Np  =  P,  nUt)  =  /,  VpmYmpW  =  ^p(0(^J(0^c(0)-S  <'^nd  the  parameter 
traii.sformation  (4.8)  is  simply  identical  to  the  parameter  transtormation  (4.4). 

It  can  also  be  shown  that  Np  >  1.  Indeed,  if  3  /.  >  0  such  that  Np  =  0,  then^  from  (4.1o), 
c-„u„(Co)  >  (r/a.  Therefore,  3  ^  >  0  such  that  Tk-i  <  t  <  ik  and  OcP)  =  ^'(0-  hi  other 
wor'ds,  if  Pf,  was  to  be  small  in  all  directions,  then  it  would  mean  that  there  had  been  enough 
e.xcitation  L  that  Cu  would  be  close  to  Cj  and  one  would  be  out  of  the  singularity  region. 
Therefore,  Np  >  1,  a„„„(Sp)  >  ep  +  dp  and  the  parameter  translormation  (4.8)  ns  well-defined. 
Basically,  the  inverse  (P/'Pp)'"  has  been  replaced  by  a  lower  order  inverse,  whose  existence  and 
boundedness  can  be  guaranteed. 

Finally,  it  can  be  verified  that  6^";/  G  Loo-  Indeed,  if  Tk-i  <  t  <  tk  or  it  G-  <  t  <  Tk  and 
a.„;.,(P^(t))  >  ep,  then  Cl(t)  =  whose  inverse  is  always  bounded.  If  U-  <  i  <  Tk  and 


amiiPl)  <  fp.  tl'p" 


Cl{t)  =  Cj(0  +  Pl'{t)Vp[t)Y:p(t)Ul(t){Cly)PUi)  -  CJW) 

=  c'!;{i)-vUp(t)uJ[t)(c^y)Rl(i)-cI(i)) 

Therelore,  using  (4.12)  and  (4.13). 

dCo.  =  UpUid.ViVjCodpUlPlLUjdCYLUj 


(4.16) 


Up  Up 


U'fClCo,Up 

0 


0 

UjCUCoUp 


Iff 

U'}' 


(4.17) 


SO  that  <7„ui.(CoJ  > 
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4.2.6  Ti-ansformation  IV  :  hybrid  implementation 

In  practice  and  need  not  be  computed  continuously.  So,  let  St  be  the  time  interval 

between  two  computations  and  define  the  time  instant  ■  as  the  j-th  time  instant  in  the  time 
interval  where  o-roi.dP/'lO)  becomes  smaller  than  ep  (because  of  covariance  resetting, 

there  could  be  several  time  instants  in  the  time  interval  [tk,Tk)  where  o-,ni„(Pp  (tj)  becomes 
smaller  than  ep).  Then,  define  tR  as  the  time  instants  in  the  time  interval  [fr-.Tfc)  such  that 
rr  ■  ( P'^iR  T  <  £p  and  R-  —  tR  +  iSt-  Finally,  given  (4.S)  and  all  the  previous  definitions,  the 
parameter  transformation  with  hysteresis  will  have  the  following  torm 

0^[t)  =  oit)  +  P{t)Q{t)  (4T8) 


with 


f  0 


if  Tk-i  <t<fk  Vfc  >  0 


if 


QU)={ 


tk<t<  Tk  Rk  >  0 
and  >  ep 


.1  .  .  jfc 

\V  1  1 1:  L  r  *  /.  ; 


0  <  Ct  <  (i/u) 


Tk  Rk  >  0 

and  rr^,.,JP^  (/.))  <  ep 

(4.19) 

and  A.  i-;  arbifi  arilv  rliosen,  but  satisfies  the  following  condition 


{c  lb) 


/'  ■■I  on'i 


ko{il  l'i)\ 


0- 


2(|g(0)!  +  2^,,.)' 


It  can  be  shown  that  the  parameter  translormation 
erties  of  section  4.2.2.  Indeed, 


(4.18)  and  (4.19)  guara.ntees  ail  the  prop- 


Lemma  4.2  :  Properties  of  the  hysteresis  transformation 

Assuming  that  b  e  Too.  and  that  the  parameter  estimation  algorithm  is  defined  by  (2.29),  then 

1.  The  transformation  is  always  uniquely  defined. 

2.  C'o/  €  T,o:, . 

3.  Q  G  Too,  0,  G  Too,  and  p,.  G  wliere  Pe  =  0,-  0\ 


5.  If  linp^oo  d’(b  ~  0  then  lim(„:,..  dc(0  —  9- 


6.  {tk  -  Tk-i)  and  {Tk  —  tk)  are  bounded  below  Vk. 

7.  {Tk}  and  {tk}  are  finite  sets. 

8.  {t^j}  is  a  finite  set. 

9.  If  P{t)  and  (f){t)  converge  to  some  Pco  and  4>oc  then  converges  to  some 

The  proof  is  in  the  appendix. 


Comments: 

The  fact  that  Q  G  Leo  is  obtained  because,  even  though  is  not  necessarily  bounded 

as  t  increases,  exists  and  is  always  bounded  when  Q  ^  0.  In  other  words,  should  P~^  be 
unl.>ounded.  cither  will  continue  to  exist  or  the  algorithm  will  come  out  o(  the  h\steiesi.s 
region.  The  fourth  property  is  most  important;  it  shows  that  the  main  property  on  /?  in  the 
estima.tion  a.lgorithm  remains  valid  when  the  estimated  pa.ia.meter  error  (p  is  replaced  by  the 
controller  pa.ramet.er  error  (jjc-  The  fact  that  the  intervals  (p,  —  Pk-\)  and  [Tk  —  tk)  are  bounded 
below  comes  Irom  the  normalized  nature  ol  the  adaptation  algorithm  and  liom  the  sepaiation 
of  the  freezing  and  unfreezing  levels  a  and  h.  It  eliminates  the  possilhlity  ol  having  an  infinite 
numbeu' of  jumps  in  a  finite  interval  ol  time,  dhe  seventh  property  tells  us  that  theie  is  a  finite 
number  of  passages  in  the  hysteresis  loop.  Alter  a  while,  the  algorithm  will  .settle  and  no  moie 
jumps  will  occur.  The  property  is  the  cousecpience  of  the  convergence  of  o  (not  necessarily  to 
zero).  Tire  algorithm  could  actually  settle  inside  the  lyy^steresis  looj).  In  that  event,  we  will  sec 
in  the  following  sections  that  the  stability  properties  of  r,he  adaptive  algorithm  are  preserved. 
Tire  eighth  juooerty  comes  from  the  fact  that  {cc}  ns  a  finite  set  when  theie  is  not  <t  sinncieiii. 
excitation.  However,  {fb}  could  be  an  infinite  set  since  i  is  not  necessarily  finite.  This  could 
occur  if  the  algorillim  settles  inside  the  hysteresis  loop,  i  ne  iasi  piaspeily  i^  cjun-rine*.! 
of  the  difference  bp  between  Sp  and  and  because  of  the  use  of  the  paiticulai  Oiam-Sclimidt 
orthogonalization  procedure  defined  in  appendix. 

Note  that  from  (4.18)  and  (4.19)  with  (4.16), 


(P[ti) 


where  r/  is  the  last  covariance  resetting  tune  instant.  Basically,  this  particular  parametei 
transformation  untreezes  Co^  in  the  directions  wliere  (Cj'  ^  )  is  sufficiently  small,  using  the 

hnowlcdf^'c  tl^at  there  lias  been  sufficient  e>?:'itatiou  in  tliose  dirertiniw.  In  oth.pr  words,  tlie 
parameter  transtormatiou  defined  by  (4.18)  and  (4.19)  checks  rrji^ji(Cu)j  ^die  miniiiuim  siugulai 
value  of  Co-  When  a^uniCo)  is  sufficiently  large,  Co,,  =  Co-  When  crnun{Co)  becomes  too 
small,  the  value  of  C\  is  frozen  (stays  constant)  until  f7„,iu(Co)  becomes  sufficicnily  large  again. 
An  important  twist,  however,  is  that  Co,  is  not  frozen  in  directions  where  there  is  sufficient 
excitation  in  the  signals. 
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4.3  Stability  analysis 

4.3.1  Error  formulation 

It  is  useful  to  represent  the  adaptive  system  in  terms  of  its  deviation  with  respect  to  the  ideal 
situation  when  (j)  ”  0.  Given  the  definition  of  the  controller  parameter  matrix  the  control 
law  (2.1)  is  rewritten  as 

=  Co  r  +  6lw  = 


u  =  L-o 

where  6c  is  a  submatrix  of  Oc-,  and  w  is  defined  as 

uC  =  [  Tcb)"  yr  ] 

with 


(4.21) 


= 


w 


(2)' 


...  sl'"’'A-’l.v„l'''  I  = 


If  we.  define  tlie  signal  r,,  as 


then,  the  matching  equality  (2.11)  applied  to  u  can  be  rewritten  a..s 


7,'  -  ■ 

-f 

II 

where 

T  i  T 

=  [  'P 

..0-  ] 

bi 

11 

given  the  definition  of  the  regressor  vector  o 

(2,13). 

If  we  define  the  control  error,  Cc,  as 

1 

11 

o 

-  0~'^)iu 

(4.22) 


Then,  from  equations  (4.21)  and  (4.22) 

'G  =  ^0  +  C'o’  —  '''  +  ~  '' 

=  Cq^''CqVt,  —  Cq^  Oc  T  —  p  ~  ^'0,:  “ 

and  tlie  output  error,  Cq  =  Up  —  ?/w  can  be  expressed  as 

e,  =  H[r,  -  r]  =  H[C--' =  H[C:~' e^]  - 

Since  Up  =  P[a]  =  //[/p],  the  control  input  can  also  be  expressed  in  terms  of  the  control  error 
as  _ 

U  =:  ?-'//[/>]  =  P-'H[r  +  cj“  ec] 


9G 


Similarly, 


10  = 


1 — 

1 

hq 

Xji)PPi 

= 

.  Vv  - 

H 

I 

+  Cq  Cc]  —  tixurp  [^‘  + 


(4.26) 


H 


[r  +  Cq  Cc]  —  H-<PrpV  +  ^0  (4-27) 


where  the  transfer  function  matrices  H^:r,  are  both  strictly  proper  and  stable.  If  we  define 

tlie  model  signals,  as  the  signals  ib  when  0  =  0 

bv.  =  H.rM  = 

then,  we  can  define  the  regressor  erroi\  ty.,  as 

=  lU..r\Cf'cb\ 


e,f.,  ^  c  —  r’ 


4.3.2  Existence  and  uniqueness 

VVe  assume  that  r  is  bounded  and  piecewise  continuous,  ilie  [uooi  ol  existence  and  uni([ueness 
of  the  solution  to  the  differential  equations  of  the  adaptive  system  is  giveii  in  the  appendix. 
It  consists  in  first  obtaining  a  state-sjiace  desci ijitiCDii  of  the  overali  adaptive  s'^si.ein  (j>lant, 
observers,  estimator),  so  tha,t  it  can  be  described  by  rlifferential  equations  of  the  form 

•7  =  .1  [b  •'■(tu)  =  .'l.'u  ('■‘■20; 

Then,  we  use  the  following  lemma. 

Lemma  4.3  ;  Local  existence  and  uniqueness  of  nonlinear  differential  equations 
Suppose  f{t,x)  in  (4.29)  is  continuous  in  /  and  x  V  i  t  [ioiT]  and  satisfies  the  loduvving 
conditions;  3  finite  constants  /,/qr  >  0  such  that 

|/(L.'i;)  —  /(Ly)|  <  “yyl  -'b?/  ^  ^d'^u)  Vf  g  [fo.T] 

|/(L^o)l  <  7  t  e  [/o,7  ] 

where  B,  {xq)  is  a  Irall  of  radius  r  ccuLercdi  at  ./  y. 

Then;  (4.29)  has  exactly  one  solution  over  the  time  interval  [Tdo  +  <^1  whenever 

kb  oxp{lb)  <  r  and  b  <  miri((T  -  T),  y,  J^) 


for  some  constant  0  <  p  <  1- 
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See  Vidyasagar  [82],  Theorem  3.4.2,  pp.  79-81,  for  a  proof  of  this  result. 

Using  Lemma  4.3,  we  show  that  3  6^0  >  0  such  that  the  system  has  a  unique  solution  over 
[0,(5o].  Then,  we  let  xq  =  ^(^0)  s-rih  we  prove  in  a  similar  manner  that  3  >  0  such  that  the 
system  has  a  unique  solution  over  T  ^i]-  This  operation  is  repeated  to  keep  extending 

the  solution.  Finally,  we  show  that  the  interval  of  existence  of  the  solution  can  be  extended 
indefinitely.  Therefore,  the  system  has  a  unique  solution  V  t  >  0  and  cannot  have  a  finite  escape 
time  (x  G  Tooe)- 

4.3.3  Useful  lemmas 

The  following  lemmas  are  useful  to  prove  the  stability  of  adaptive  control  schemes. 

Lemma  4.4  :  Input-output  Lp  stability 

Let  1/  =  H[u],  where  H  is  a  proper,  rational,  square  matrix  translcr  function.  Let  h  be  its 

impulse  response. 

If  h  is  stable,  then 

Vp  G  [1,  co)  and  Vu  G  Lp 

||y|lp<lih||i||u|l,Giic|i, 

ZL  ^  I.J  0Q  g 

\y{t)\<\\h\U\\u,\\^L\e{t)\ 

w'here  e{t)  is  an  exponentially  decreasing  term  due  to  initial  conditions. 

For  a  proof,  cf.  Dosoer  k  \''idyasagar  [81],  pp.  241. 

Lemma  4.5  :  Output-input  Lp  stability 

Let  y  =  H[u],  where  H  is  a.  proper,  rational,  square  matrix  transfer  function. 

If  H  is  minimum  phase  and  if  3ki,  /c2  >  0  Vu,  ii  G  Lp^  such  that  |lh(||p  <  ki  ||ui|lp  +  ^2,  then 

3Gi,a2  >  0  such  that 

IjGillp  <  Gi||y(||p  +  <22 

Lemma  4.5  is  a  trivial  MIMO  extension  of  Lemma  3.6.2  in  Sastry  k  Bodson  [3]  when  H  has 
a  diagonal  Hermite  form.  If  H  does  not  have  a  diagonal  Hermite  form,  then  3  always  a  stable 
and  minim.um  phase,  proper,  rational  diagonal  square  matrix  transfer  function  L.  such  that 
Lll~^[y\  =  Z/[u]  with  LH~^  stable  and  proper.  Then,  the  MIMO  extension  of  Lemma  3.6.2  in 
Sastry  k  Bodson  [3]  can  be  applied  to  L[il]  and  the  result  follows  from  Lemma  4.4,  since  LLI-^ 
is  stable  and  proper. 

Lemma  4.6  :  Input-output  convergence  to  zero 

Let  y  -  H[u],  where  H  is  a  stable,  rational,  square  matrix  transfer  function. 

If  H  is  strictly  proper  and  ii  G  L?  or  H  is  proper  and  rt  G  L2  0  Lpo  w'ith  lim(_,co2i  —  0,  then 
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?/  €  ^-2  n  Leo  and  lim(_»co  V  =  0. 

If  H  is  proper  and  u  G  Loo  with  lim(_oo  =  0i  then 
y  &  Loo  and  limj^oo  y  =  0. 

When  H  is  strictly  proper,  see  Desoer  &  Vidyasagar  [81],  ex.  5,  pp.  242,  for  the  first  part 
of  the  lemma,  and  see  see  Desoer  &  Vidyasagar  [81],  Theorem  9,  pp.  59,  for  the  second  part 
of  the  lemma.  If  H  is  proper,  then  H{s)  =  Ho  +  H,p{s)  with  strictly  proper.  Therefore, 
y  =  Hqu  +  Hsp[ii]  and  the  results  follow. 

Lemma  4.7  .•  Output-input  convergence  to  zero 

Pet  '(/  =  //['(/],  where  H  is  a  proper,  rational,  square  matrix  transfer  function. 

If  H  is  minimum  phase,  u  G  Leo,  V  G  Lee-,  and  lim,_co //  =  5,  tlnni 

u  G  Leo  and  lim-_o:,  ii  =  0. 

The  i>roof  is  in  the  appendix 


4.3.4  Stability  proof 

the  follciwiug  fheorem  is  the  mam  stability  theorem  for  the  MIMO  hlL.AO  system.  It  sho\..s 
tliat  given  any  initial  condition  and  any  bounded  input  r(f),  the  stales  o!  the  adaptive  system 
remain  bounded  and  tlie  output  error  converges  to  zero  as  /  -e  oo.  Furthernrore,  the  difference 
between  the  regressor  vector  0  and  the  corresponding  model  vector  converge.s  to  zero  as 

/  — cc  and  is  in  L-.. 


Theorem  4.1  .-  Global  stability  of  the  direct  MRAC  system  -  Kp  unknown 
Consider  the  MIMO  MR.AC  system  described  in  Section  2.3.1  A.ssume  that  the  parameter 
estimation  algorithm  (2.29)  and  the  hysteresis  translormation  (4.18)  and  (4.19)  are  used.  II  the 
reference  input  r  G  Lo-,  and  is  piecewise  continuous,  then 

•  All  slates  of  tlie  adaptive  system  are  bounded  function.s  of  time. 


•  The  output  error  Co  =  yp  —  'ihn  C  Loo  and  lim(_.^  to  =  0. 

•  The  regressor  error  eg  =  L  —  'i/’,,,  G  Loo  C  Li  and  ling^co  fg  ~  0. 

For  tiie  stability  proof,  wc  follow  similar  steps  as  tor  the  SISO  stability  proof  of  Sa.stiy  V  Boclson 
[3j.  The  significant  ingredients  of  the  proof  are  that  there  is  finite  number  of  passage,s  in  the 
livstero.si.s  loop  and  that  A.,  has  the  same  properties  as  d  (c/.  Lemma  4.2).  Hence,  the  standard 
.stability  and  convergence  properties  are  preserved. 
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The  layout  of  the  proof  is  as  follows.  First,  we  express  properties  ol  the  parameter  identifier 
that  are  independent  of  the  stability  of  the  adaptive  control  system.  Such  properties  are  gen¬ 
erally  expressed  in  terms  of  the  identifier  error  62  (c/.  (2.15)).  Then,  we  show  that  the  mam 
properties  are  preserved  by  the  parameter  transformation.  Finally,  we  transfer  the  properties 
of  the  identifier  to  the  control  loop  and  prove  stability. 


Proof  of  Theorem  4.1 

A.  All  signals  belong  to  •^coe 

In  section  4.3.2,  we  have  shown  that  (yp,  irF),  belong  to  and,  therefore,  (to,  to,  tt, 

/■p,  z)  belong  to  Lacc- 

B.  -0  is  regular  and  all  signals  arc  bounded  by  ||i/b||co 

Let  .'c,.T,.%+  G  Acx.c-  Then,  we  say  x  is  regular  i{[  BkiJc-,  >  0  such  that 

<  L'l ll.rtllco  +  ^2 


Recall  from  (4.23)  that 


and  from  (4.26),  that 
witli  Iliir;,  stable  and  st 


''v  —  ^0 

U'  — 

ctly  proper.  Therefore,  applying  Lemma  4.4 


‘'O !  V  V  c  ) :  I 


-7- TO 


<  /cH(dfT7;)i||oo 


-f  k 


for  some  constant  k  >  0.  Again  we  use  the  single  symbol  k,  whenever  an  inequality  is  valid  tor 
some  positive  constant.  Since  (pc  is  bounded 


d 

(It 


k;|  <  't||T0t||oo  +  k 


SO  that  TO  is  regular.  Now,  recall  from  (4.27)  that 


'  /-HCr'Crmr]  ' 

’  f-TCT  ''6T-w] 

—  /  '  [  c  j  — 

0  _ 

-i- 

vs'here  /(.s)  is  stable  a,n(l  dl{s)  >  <1.  Then,  by  a,p])!ying  Lemma  4.4 

i'/’i  <  k\\{P^  To)(||co  d-  />:|1t0(|1co  +  k  <  T|jTO(|jco  +  k 

I— ■(/■j  <  k\\{^'^w)t\\c<,  +  /tll'TOtllco  +  k  <  L||TOt|l,->,  +  k 

(It 
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Now,  dsfinc  'll’  3.S  /  ^[?u].  Since  u>  is  regulfir,  /  ^  is  strictly  pioper  a.iKl  inininium  plia.se,  bj'' 
applying  Lemma  4.5 

\w\  <  L'llV'illco  +  k 

and  since  ]i^l  <  [ipl 

|iZi|  <  kWtpiWoo  +  k 
1  — i/^l  <  k\\tpt\\o^  +  k 

so  that  is  regular.  Now,  from  (4.23) 

1  ’/'p  i  ^  /C  I  LI'  I  +  /C  <  ^  II  1 1  CO  “i“  ^ 

and  since  z'^  =  J  /-J  | 

l^l  <  k\w\  -r  k  <  Ailldnllco  +  k 

Similarly,  since  xl  =  Olin 

l'u|  <  k\v'\  -r  k  ^ 

and  a.pplying  Lemma  4.4  io  y^,  = 


!.V;4 


'  /v  Ird’/ +  k 


< 


Conscc|uentlv\ 

l'"4:  il/p!;  !"'i 

and  if 'd  is  prov'ed  to  be  bounded,  tlien  all  .signals  will  lie  bounded. 

C.  limf-^co  Pc  =  0 

This  comes  from  the  regularity  ol  d'-  Indeed,  let  N  >  bv  ^  0 


_  I )■'/-’ (N)  _  I  {i2)4’{i2) 

1  +  1 1 '0(2  11  CO 


I  +  W'^Pt-L  lie 


•d(/i) 


l  +  ll'0(illco  ^  T  IlgTi  llco  -1  T  1  I'd r.2  11-0 

|k-  —  |lv/^.  lU-,  ) . 

<  Kd'' (N)  -  dd' (bi))l  +  led  (tc)!; 


1  +  \[Pt 


<  IN  -  NlllNllco  +  In  -  b>ll'K0)l^k4k4k  + 


(ll'Nn llco  ~  ll'di2 lice 


1  ■  !i,s  i: 

1  -r  II t,  lico 


1  +  lid 


'cn  iic^ 


I  +  iiV’nli.-.c 


<  In  ~  nI(I1^11.x.  +  2d|d'(o)i) 
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Therefore,  V  e  >  0,  3  6  = 


such  that  V  ti,t2  >  0 


4>\\^+2mo)\' 

\t^-t^\<S  =>  IPiti)  -  P{h)\  <  ^ 


so  that  p  is  uniformly  continuous  in  t.  Consequently,  |/?p  is  also  uniformly  continuous  anc^  ^nce 
Be  ^2  n  Tc«,  by  Barbalat’s  Lemma  {cf.  Lemma  1.2.1  in  Sastry  &  Bodson  [3]),  hmi^ooP  -  0. 
From  Lemma  2.3,  {n-}  is  a  finite  set  of  size  K  if  is  not  SE.  Therefore,  the 

exact  same  reasoning  can  be  applied  to  tt  =  to  show  that  tt  is  uniformly  continuous 

V  t  >  r;., ,  hirq^eo  ^  =  0,  and  lim<_^  P  -  0,  if  ^ 

Q  e  Loo,  it  follows  that  linq^co  Pc  =  0  if  is  not  SE.  Finally,  if  is  SE,  then 

hm(_.coCo  =  Cj.  Therefore,  3  T  >  0  such  that  fUt)  =  /?(0  V  t  >  T,  and  Pc  =  0. 

D.  Relationshi])  between  output  error  and  identification  error 
Recall  from  equation  (4.2o)  that 

eo  =  Vp  -  !hu  =  P[Q‘<pr-] 

therefore 

(/LL)-'[eoj  =  <JlLY'[llv  -  yY  =  L^'[CpY>cY  ^''-itli  (--30) 

Now,  this  can  be  used  to  transfer  convergence  properties  from  tlie  identifier  error  to  the  output 
error. 

,  1  T  _  _  p  .  r  =  n 

E.  All  sii^iipcls  H-ie  ijtui ticleO ,  iirii:;--^oo 

Suppose  that  {AA^’}  is  a  minimal  realization  of  C{sl  -  A)-^ B  =  Let 

and  I'L  such  tnat 

,r  =  Ax  +  Bz^PcC^" 
ti/  =  AW  ^  Bz^ 


X 


then 


Cx  —  I 
ciF  = 


SO  that 


l-%y:p^Y  =  c^!PcP  +  {C[x  -  w<pxV  ))^ 

Furthermore,  Vf  ^  T  =  {T-}  U  [Tk]  U  {r,}  U  {/f;,} 


(It 


(:i:  -  W(pXV)  - 


(4.31) 


(4.32) 
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where  Wt  ^  T 


^)  =  +  PQ^o,  +  PQP'Oc  ~  Coc^Oc 

at 


(4.33) 


and  yt  ^  T 


Cl  =  0 


rT  _  _„Pl±}iLi 


if  Tk  <  t  <  tk+i  yk 

if  tk  <  t  <  Tk  and  (PT(t))>ep  vt 


CJ  +  PlQWj)  =  -/'y+yy"  oH'=r"’lse 


and  yi  4  T 


if  Tk  <  t  <  /ah 


Q  =  -.jfm. + !jPAifp,.)-'pr^yi$yf°Q  -  pAPip.r'c^  if  { tllS'l ' 


otliei'vvise 


Define  (  such  that 


oCr'  ’f  <  f  <  /A:+1  V/,: 


0  oiiierwisc 


Lhen  h  G  Ly  i  *  Dehru'  c  'SUv.ii  ina; 


nT  +  '  P  f  PT  p  ]-l  pT  y.fj  ^k<t<Tk  V^' 

Pv  CwCdC  CJ  C-  fT,,,,(P;(/))>ep 


[  0  otherwise 

Then,  given  the  properties  of  the  identifier  [cf.  Lemma  2.3)  when 
the  fact  that  3  T  >  0  such  tliat  C’o,(/)  =  Co{t)  and  C{t)  =  0  V  f  >  T  when 
and  given  the  fact  that  [Pj Pp)'^  is  bounded  if  ^luin  (pp  >  £p,  f  e  n  n  i». 
Define  v  —  tha.t  V  '^ ;/ 


'T-'  _  PV-AT/f^ PQ 

Uc  C  l-\~'yil/P  iIj 


’f  if  <  '  <  'f,4iP 


0  otlierwise 


(4.34) 


Then,  given  the  properties  of  the  identifier  (c/  Lemma  2,3)  when  SE  and 

given  the  fact  that  3  T  >  0  such  that  Co^{t)  ~  Co{t)  and  x(0  =  0  V  i  >  T,  when 
SE,  X  €  ^2  n  Leo.  Given  the  definition  of  G  ^rid  x,  using  (4.33) 

^{(l>cCj/)  ==  {4  +  C  +  (  +  x)Co,  Vt^T 

Define  A7^,  A^;.,  and  A^j:^,  as 

Ar^.  =  {^cCq^  )\i=Tk  ~  {^cCq^  ht=T- 

A;-^  =  {<PcCq^  )|(=ri.  —  {<I>cCq^  h(=-^k 

Ajfc  =  (dc^'O,.  )|?  =  f.‘^  i^C^Or  = 

IJ  '  '  'J  ‘  ‘J 


tlien.  At,,  A.,,,  and  A,.  £  L,-o  {cf.  proof  of  Lemma  4.2).  Also,  note  that  A 

'  K  A:  ‘■jj 

that  Tk-  <  n-  <  h-+i- 

Finally,  combining  together  (4.32),  (4.34),  and  (4.35) 


0  if  3  k~  such 


/n- 


=  A'‘(.r-fFd,Cp  )i,.o 

-  f  c-''^'-"'ir(r)fd(r)  -f  C(r)  +  ^{t)  +  Y(r))Cp‘ (r)r/r 

Ju 


a('-J4)u/ 


E 

TkO- 


;.)Ar,..s(/  -  T,)  -  e-('-"'^4F(r,)A,,.sit  -  r,-) 


where  sit)  is  the  unit  step  function.  Using  (4.30)  and  (4.31) 

{HLy^[eo\  =  CYfci'  +  {Ct'^\x-W<}>,CY')\i=of 

-( I'  C'c/'(‘-"^VU(T)(d(T)  +  C(^)  +  +  x{r))CY' 

-(  E  CU'^('-^'=)fU(n)AT,.s(/.  -  Tk)f  -  (E  6’e-"('-"^-)H/(r,)A,,.s(f  -  n)f 


<  t 


rk<f 


-(  ^  c;e'"-nn-(f‘ -  (‘ ))' 


<t 


and  .since,  by  Lemma  4.4,  |l'U|  <  A:ji-,|j;.., 
,(//L)-Meo],  ./ 


1  + 


i  ::n  ^ilL’dlco  +  k 

!,|  +  |e(f)|  -{•  k  f  +  C  +  (  +  xk/r  +  k  E  -  Tk) 

r. 


Tk<t 


+k  ■£  iei'-'‘'iiA.j.s(i  -  n)  +  k  y;  |e.-'i'-‘n|]A,o..(/  -  (‘) 

Tk<t  (y<( 
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where  c{t)  is  an  exponentially  decreasing  term.  Since  (^  +  Cd"^d“X)  ^  -^co?  applying 

Lemma  4.6 

Tk<i 

+k  Y:  +  WHU  (4-36) 

tf^<t 

where  ^■‘€1,2  61  L^o  and  /5‘  =  0.  Since  {HL)~'^{yp)  =  r~‘[rp],  from  (4.26)  and  (4.27) 


V’  = 


I 

Hu-r„ 


(HLY'b,] 


and.  a.pp^diig  Lemma  4.4 

1-01  <  Lli(//L)-^[y,01U  d-  it(/)|  <  A:ll(//L)-‘[eo],iU  +  A.- 

Therefore,  (4,36)  is  equivalent  to 

l(//L)-Meo]|  <  (A/;r  +  kY  -  T,)  +  A:  ^ 


Tk<i 


rk  <  f- 


+k  Y  U(^-g))(i  +  |!(/7L)-Mf^o],iloo) 


(4..3S) 


In  this  expression.  =  6:  {Ti:}  is  finite,  {/o,}  is  finite,  and  /L  =  + 'oA-,  V  /. 

Furthermore,  if  's  SE,  3  A:*  >  0  such  that  =  0,  V  /c  >  and  i.s  a  finite  set. 

(lET'dh'P'/u  SE,  (r;.)  is  a  finite  set,  !im._^.,  ^(f)  =  dco,  hnii-co -^(0  =  -Cx.,  and,  from 

Ltnmiia.  4.2,  lui'i,_;o  i  =  6-  Conse([uenU3',  uF  >  0  such  that  V/.  >  7 

k3’  -f  /cF|e^^‘-^'-d|,s(/.  -T,:)  +  A:V  |e^^'-"‘=>||A,J.s(/.  -  r,) 


T. 


St  E  h)  <  1 


and 

l(7/F)-Meo](A)|  <  L||(/7F)-’[eo]7-|U  +  k  t  >  T 

Note  that  thi.s  can  be  interpreted  as  an  application  of  the  small  gain  theorem  {cf.  Sastry  F. 
Bodson  [3],  pp.  149).  Since  (//L)“^[eo]  G  Lc<.ti  it  iollows  that  {H L)~^[eo]  G  L^.  Then,  trom 
(4.3S) 

|(//£)-'[c„!|  <  k(r  +  k  E  _  7' )  +  k  E  -  ’•n 


Therefore,  =  0.  From  (4.37),  it  follows  that  ^  e  Foo  and,  consequently,  all 

signals  in  the  adaptive  system  are  bounded.  Furthermore,  since 


-  ^m)  = 


I 

H-diTp 


{HL)-^[eo] 


(4.40) 


with  Hi-uTp  strictly  proper  and  stable,  by  Lemma  4.6,  we  have  that  e^,  -  jipm)  ^  -Fco  and 
limt_H.co  ev-  =  0.  Then,  by  applying  Lemma  4.6  to  {HL)~^[eo],  we  have  that  L  ^[eo]  €  Loo  and 
lim(_^oo  L-^[eo]  =  0.  Then,  by  applying  Lemma  4.4  to  (4.25) 


—  Co!  <  '^'llrwillco  +  1^(01 
(It 


so  that  Co  G  Leo-  Finally,  from  Lemma  4.7,  to  G  and  lirni.^co  eo  —  0. 


F .  G  L2 

We  first  show  that  tlie  error  term 

it  is  SE,  ti.c.i  {/q  I.S  .-S  Unite  set  end  E(t)  =  /.■£(()  r.nti,  ,(/)  eximnenlialjy 

decreasing.  However,  if  ^ot  SE,  {fh}  could  be  either  a  hmle  set  or  an  inhnite  sei 

depending  on  where  Co  and  F,  converge.  If  {/L}  is  a  finite  set,  tlien  again  E{t)  =  ke[t)  with 
e{t)  exponentiallv  decreasing.  Now,  suppose  that  6’o  and  converge  10  some  value  such  tha^ 
is  an  infinite  .set.  Since  {r,}  and  {,-■}  are  finite  set,  using  the  fact  that  lim^oc  -  U 

and  the  fact  that  linq^cc  E{t)  =  0,  then  3Te{tk],T>  max{f(j^}  >  inax{T,.}  such  that 


E^{t)dt 


< 


Vic(i)P  +  C£(<)l)e 


+ /“(  '  E  "  !eot™o)|,A,,,,^,,j,,(<-(r  +  M,))E/< 

1=0 


CO 


/=:0 


< 


ei-tE(Elv'''''‘!l^d,=rx(.-.).<,l)’ 

6=0  1  =  {J 

<  k  +  UE  E(iA.;^,,„,,,r'  +  2  E  lZ''''l|a,t^  =  TtK,ll^<‘=T+|lt,:).vl) 

-o  (_0 
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oo  CO  CO 

<  t  +  HJ:  +  2(E  N^”‘'l)|A,f,.r«.P) 

S=0  l~0  ^ 

CO  03 

<  ^  l^(*  =T+;5,I  ) 

i=0  /=0 

oo 

<  A:  +  fc  ^ 

l-o 

where  e{t)  is  an  exponentially  decreasing  term.  From  (7.7),  (7.9),  and  (7.10)  in  the  proot  of 
Lemma  4.2,  assuming  that  T  is  sufficiently  large  so  that  Np  is  constant  V  t  >  T,  that  the  order 
of  selection  of  the  columns  in  the  Gram-Schmidt  orthogonalization  procedure  with  memory  is 
constant  V  t  >  T,  and  that  \8Pj\  <  miii(l,  d?,/4)  over  the  time  interval  [/,  ^  +  ^(]  ^  i  >  T,  then 


\8UpT,p^Vp\  <  + 

|6F,|  <  k\5Pj\ 

|(^[/o|  <  lc\SP^  \  p  k\8C{j\ 


Therefore,  since  Co  and  are  uniformly  continuous  V  /.  >  T 
r  E\i)dt  <  /c +  £(/.: 


l-\ 


rTA-ltSt  .  rT+Z.S  . 


CO  ^T'a./.S',  rT4-/<‘!'f 

kpk{j:l  '  '  \p,c)d!n'' p \PAn\p 


1  =  1 


<  k 


\P^{t)\dty  +  k  ^\P,{i)\dt 


T  A-v  /  1^  pV  ,  .  . 

T  -JT 


\Comiy 


< 


since 


Pp  and  Co  G  ^2  n  Li  when  is  not  SE  (c/.  Lemma  2.3).  Therefore,  P(0  G  Pi, 

and,  from  (4.39),  {IIL)-'^[eo]  G  L2-  Then,  by  applying  Lemma.  4.4  to  (4.40),  we  have  that 
ey-  =  ('0  —  '0m)  G  02- 


□ 


Finallv,  note  tb.at  there  are  no  reciuirements  on  the  reference  signals  r  except,  of  course,  that 
they  are  bounded  and  piecewise  continuous.  However,  exponential  convergence  is  achieved  only 
if  the  regressor  vector  yt  is  PE  (c/.  Lemma  2.3).  Also,  the  regressor  erroi  signals  aie  pio\en  to 
be  in  L2  (this  was  not  proven  lor  the  SISO  algorithm  of  Lozano  et  al.  [74]).  Thi.s  result  allows 
to  extend  the  SISO  parameter  convergence  result  to  this  algorithm  (see  Chapter  0). 
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4.4  Examples 


4.4.1  Example  1 

Let  the  plant  be  a  (2  x  2)  system  of  order  4,  with  the  following  transfer  matrix 


P{s) 


—  2s^~-7s^  —75  —  4 
53_l352_|„35_}_2  5^+45^4-6524-55+2 

5^ +35^+35  +  1 


L  53-1-352+35+2  5^+453+652+55+2 

The  observability  indices  are  =  2  and  m  =  2,  the  system  is  stable  and  minimum  phase.  Let 

(f  +  1)  0 


A(.s; 


(5  + A)  0 

0  +  A) 


A  >  0 


L{s)  = 


0  (f-fi) 


/  >  0 


yV/(.s)  =  H{s)  = 


0 


(  5  +  1  ) 

0  ' 


(5+1)  J 


then 


Q  -  e:’  = 


1  2 

i)  i 


U,.;,.(r4)  =  0.4142 


C-(s) 

D-{s) 


Or,(._'  —  0  L  2 


A  -  2  4 

- 1  A  +  1  ^ 

(3  -  A)5  -I-  3  -  A  (3  -  2A).s  +4  -  2A 
s  +  1  (1  “■  +  2  —  A 


dcdJ‘  =  1  <  n,  —  i 


Therefore,  tlie  unknown  para,meter  matrix  is  given  by 


= 


1  2  A  -  2  4  A-  -  4A  +  3  2A2  -  5A  +  4  3  -  A  3  -  2A 

0  1  -1  A  +  1  1  -  A  A^  -  2A  +  2  1  1  -  A 


where  the  number  of  unknown  parameter  No  =  16.  The  regressor  vector  is  defined  by 


y,. 


yp2  yp}  yp'2 


(5+l)i/p|  (5  +  l)yp.;  ni  np  .  .  _ -  -  - - 

/(I)  /(5)(5  +  A)  /(5)(5  +  A)  /(5)(5  +  A)  l{ii){s+X)  l{s)  U'O 


VVc  pre.sent  simulations  of  the  adaptive  system  with  and  without  the  hysteresis  transformation  to 
show  how  important  the  parameter  transformation  algorithm  is  for  convergence  and  stabihtN'. 
In  oui  simulations,  the  different  parameters  arc  set  to  the  following  values;  A  =  4,  /  10 

_  IQ^  _  0,  ko  -  1,  ki  =  0,  ko  =  0.  17  =  0.1,  a  =  2,  h  =  4,  ep  =  10  ap  =  2,  and  the  initial 

estimate  of  the  parameters 


^"(0)  = 


-4  U  0  0  0  0  0  0 

0  -0.5  0  0  0  0  0  0 
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Therefore,  cr,„i„(Co(0))  =  0.5  >  a.  The  reference  inputs 

Ti  =  sin(5/)  +  sin(7l‘)  +  sin(lOi) 

r2  =  sin(6!!)  +  sin(8<)  +  sin(9f) 

contain  6  frequency  components  each  and,  consequently,  are  sufficiently  rich  to  guarantee  per¬ 
sistency  of  excitation  (see  Chapter  3,  Theorem  3.2). 

In  the  first  simulation,  the  adaptive  control  algorithm  has  been  implemented  with  the  hys¬ 
teresis  transformation.  The  evolution  of  the  norm  of  the  output  error,  eg  =  yp  —  Vm,  is  shown  in 
Fig.  4.2.  After  a  transient  of  about  20  seconds,  the  output  error  rapidly  converges  to  zero.  The 
singular  values  a',„i„(CoJ  and  a,„i„(Co)  are  compared  in  Fig.  4.3  and  Fig.  4.4  for,  respectively, 
the  first  5  and  20  seconds  of  the  simulation.  One  sees  that  the  system  goes  three  times  into  the 
hysteresis  before  finally  settling  outside  the  hysteresi.s  region.  The  time  imstants  (in  seconds) 
for  entering  and  leaving  the  hysteresis  are  C  =  0.165.  Tj  =  0.208,  I-/  =  0.509,  T2  =  1.762. 
t:i  =  2.224,  and  T3  =  16.319.  It  can  also  be  seen  that  rr„j„(6'(j)  goes  to  zero  6  times  during  the 
simulation  before  converging  toward  cr„u„(C',;)  =  0.4142  (see  Fig.  4.5).  During  the  simulation, 
(^nuu{-Pp)  stayed  above  tp  inside  the  hysteresis  region.  For  illustrative  purposes,  the  controller 
parameters  and  are  shown  in  Fig.  4.6  and  Fig.  4.7  for,  respectively,  the  first  5  and 

50  .seconds  of  the  simulation.  In  our  simulations,  we  observed  that  generally  one  passage  or 
no  passage  at  all  into  the  hysteresis  are  more  likely  than  multiple  passages.  To  obtain  multi¬ 
ple  passages  in  the  simulation,  we  selected  input  frequencies  well  a,bove  the  bandwidth  of  the 
reference  model  (which  would  not  typically  happen  in  a.n  adaptive  control  system). 

Finally,  the  .same  simulation  wa.s  executed  without,  the  parameter  transformation  algorithm. 
The  norm  of  the  output  error  is  shown  in  Fig.  4.8  and  cr,„j,,(Co)  in  Fig.  4.9.  Clearly,  alter  a  fast 
ciuick  [jassa.ge  tiirough  the  zero  region,  CuvialCo)  converges  into  the  zero  region  aiul  does  not 
leave.  The  control  parameter  matrix  Cq^  —  Cg  settles  in  a  singularity  region  and,  consequently, 
suppresses  part  of  the  reference  input  excitation.  Model  matching  is  now  iarpossible  and,  as  Fig. 
4.8  clearly  shows,  the  output  error  does  not  converge  to  zero.  These  simulations  demonstrate 
how  important  the  transformation  is:  without  the  transforma, tion,  convergence  might  not  occur. 
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5 


A 


3 


2 


Figure  4.8:  |eo(01  parameter  transformation) 


- - - — j— - ^ 

3  <  5 


"li  _ 

6  5 

Figure  4.9:  crjniri(C'o(0)  (^^'ithout  parameter  transformation) 


0.1 

e.eSj 

e.es.b^ 

0,64  ! 
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4.4.2  Example  2 

Let  the  plant  be  a  (2  x  2)  system  of  order  3,  with  the  following  transfer  matrix 


P(s)  = 


52+5  +  4 


0 


TTlJ 


The  observability  indices  are  i/j  =  2  and  1^2  =  L  the  system  is  stable  and  minimum  phase.  Let 
A(s),  L{s),  and  M{s)  =  H{s)  be  as  in  Example  1,  then 


a- 


C-(.s) 


Z)‘(s) 


A  -  1 
0 


1  0 
0  1 

0  ' 

1 


(C„-)  =  1 


di'iC’  =  0  <  —  2 


—  As  +  4  —  A  0 
0  A  -  2 


dciD’  =  1  <  ;/i  -  1 

dciD'  =  0  <  /^2  “  f 


Therefore,  the  unknown  parameter  matrix  is  given  by 


O' 


r 


■  1  0  A  -  1  0  A2  -  A  A  4  0  -A 

0  1  0  1  0  A  -  2  0  _ 


where  t!;e  number  of  unlrnovvn  j^a-iameter  .An  =  14.  The  regressor  vector  is  defined  Iry 


;T  1  (i+i)ypi  (s+i)!/pn  :ii _ _ ifp _  _ iyrr _  Igj_  1 

—  [  ;(,p  i[i]  i(.y(p  +  .M  ''o)w+-'d  ‘i^)  J 

VVe  present  simulations  of  this  decoupled  multivariable  adaptive  system  with  tp  >  0  (selective 
hysteresis  +  projection)  and  with  ep  =  0  (simple  hysteresis  +  projection)  to  illustrate  the 
necessity  of  the  selective  hysteresis.  In  our  simulations,  the  different  parameters  are  set  to 
the  following  values:  A  =  2,  /  =  10,  (j  =  20,  7  =  0,  ho  =  1,  Ly  =  0,  k-z  =  0,  cr  —  0.8, 
a  =  5,  6  =  10,  ap  =  100,  6)  =  0  (for  a  2  input  2  output  .system,  all  the  quantities  in  the 
parameter  transformation  have  an  analytic  expression  and  the  hybrid  implementation  was  not 
implemented  in  the  simulation),  and  the  initial  estimate  of  the  parameters 

-1  0  oooooo' 

0  -1000000 


The  reference  inputs  are 


'''2 


[  sin(2/)  +  cos(4!‘)  if  f  <  4 

\  0  if  t  >  4 

f  0  if  f  <  12 

1  sin(/) -f  sin(3f)  it  t  >  12 
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so  that  ri  contains  some  excitation  only  V  f  <  4  and  r-2  only  V  Z  >  12. 

In  the  first  simulation,  the  adaptive  control  algorithm  has  been  implemented  with  ep  =  O.OS. 
The  evolution  of  the  norm  of  the  output  error,  Co  =  Vp-Vm,  is  shown  in  Fig.  4.10.  The  singular 
values  <T,nin(C'oJ  and  cr.nin(C'o)  are  compared  in  Fig.  4.11,  the  parameters  and  Con  m 

Fig.  4.12,  and  the  parameters  and  in  Fig.  4.13.  At  first,  there  is  only  excitation  in  the 
first  input,  C'o„(Z)  starts  converging  from  -1  to  1,  and  stays  equal  to  —1.  At  ti  =  0.22, 

the  system  enters  the  hysteresis  region  when  crmin(C'o)(^i)  =  |C'on(^i)l  ~  ~  C'oc(0 

is  frozen  at  its  value  at  h  (Co(ii))-  After  t  =  4,  there  is  no  signal  in  the  first  input  any  more  and 
the  coefficient  Co,,{t)  converges  toward  0.113,  inside  the  hysteresis  region  (0.113  <  aju  =  0.16). 
In  the  mean  time,  Co,(Z)  stays  frozen  at  its  value  at  Zi  (he.,  :=  -O.OS,  =  -1,  and 

the  off-diagonal  terms  are  zero).  After  t  =  12,  there  is  e.xcitation  in  the  second  input  and 
starts  converging  from  —1  to  1.  However,  Co^  is  still  frozen.  At  /qj  12.42,  rr„u„(Pj^  ) 
becomes  smaller  than  tp  =  O.OS  and  Co,  is  partially  unfrozen  (cc.,  Co,.,.,  is  unirozeu  and 
stay.s  frozen).  Finally,  after  a  short  transient,  the  output  error  converges  to  zero.  Note  that 
^nnn{Co{t))  goiiig  to  zei’O  at  t  =  12.12  in  Fig.  4.11  corresponds  to  (7u,,(Z)  passing  through  zero. 

The  same  simulation  was  executed  with  the  simple  hysteresis  -b  projection  (ep  =  0)  instead 
of  the  selective  hysteresis  +  projection  (ep  >  0).  1  he  norm  ot  the  output  error  is  shown 

in  Fig.  4.14.  After  A  =  0.22,  Co,  becomes  frozen.  However,  6'u,  stays  completely  irozen  even 
when  there  is  excitation  in  the  second  input  {t  >  12)  and  the  signals  rapidly  become  unbounded. 
These  simulations  clearly  illustrate  the.  importance  of  the  selective  hysteresis. 


Chapter  5 

Structural  adaptation 


5.0  Introduction 

In  this  chapter,  we  show  how  the  estimation  of  the  structural  parameters.  Ilermite  normal  form 
H{s),  observability  indices  {;/.},  and  pseudo-observability  indices  {p,-},  can  be  introduced  m 
adaptive  control. 

In  chapter  4,  we  introduced  a  parameter  transformation  that  removes  the  requirement  of 
a  priori  knowledge  of  the  high-frequency  gain  matrix  in  direct  MRAC  schemes.  However, 
the  a  priori  knowledge  of  the  full  interactor  matrix  or  Hermite  normal  form  was  still  required. 
Algorithms  have  appeared  in  the  literature  (e.g-,  Elliot  &  Wolovich  [11],  Johansson  [13],  Dugard 
et  al.  [12],  Dugard  tt  al.  [28],  Sca.ttolini  Clarke  [17],  Ortega  ct  al.  [14],  Das  [7],  a,nd  Dion 
et  al.  [50])  reducing  this  requirement  to  the  a  priori  knowledge  of  the  relative  degrees  {r.}  of 
the  elements  on  the  diagonal  of  the  Hermite  normal  form  (see  Definition  1.4).  However,  when 
the  interactor  matrix  is  not  fully  known,  stability  is  not  proven  for  the  algorithms  proposed 
by  Elliot  &:  Wolovich  [11],  Joliansson  [13],  Dugard  et  al.  [28],  Scattolini  &  CiairvC  [I7j,  Das 
[7],  and  Dion  et  al.  [50].  The  proof  of  stability  proposed  in  Ortega  et  al.  [14]  is  incorrect. 
Furthermore,  the  proof  of  stability  sketched  in  Dugard  et  al.  [12]  suffers  from  serious  problems. 
Indeed,  in  Dugard  et  al.  [12],  a  modification  (identical  to  the  one  presented  in  Goodwin  et  al. 
[19],  Lemma  9.1  and  later  used  in  Goodwin  &  Long  [20])  is  used  in  the  discrete-time  parameter 
identifier  to  avoid  singularity  of  the  estimate  of  the  time  delay  gain  matrix.  This  is  necessary 
because  its  inverse  must  be  computed  in  the  implementation  of  the  control  law  (similarly  to 
control  law  (2.3)  and  (5.2)).  However,  even  if  their  modification  is  implemented,  the  estimate 
of  the  tim.c  delav  gain  matrix  can  s" ill  converge  arbitrarily  close  to  singularity  if  the  regressor 
vector  is  not  sufficiently  exciting.  Therefore,  even  if  it  can  be  proved  in  theory  tliat  the  control 
signal  u  is  bounded,  in  practice  u  may  not  be  computable  when  the  estimate  of  the  time  delay 
gain  matrix  converges  dose  to  singularity.  Furthermore,  this  modification  cannot  be  adapted 
to  continuous-time  systems.  Therefore,  for  all  practical  purposes,  knowledge  of  the  time  delay 
gain  matrix  or  the  high-frccjuency  gam  matrix  must  be  assumed. 
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In  this  chapter,  we  present  a  direct  continuous-time  MRAC  scheme  requiring  only  the  knowl¬ 
edge  of  the  relative  degrees  {r,-}  of  the  diagonal  elements  of  the  Hermite  normal  form  and  an 
upper  bound  on  the  maximum  of  the  observability  indices.  Global  stability  is  proven  without 
requiring  a  priori  knowledge  of  the  high-frequency  gain  matrix,  by  using  the  parameter  trans¬ 
formation  presented  in  chapter  4.  This  result  finaUy  makes  MIMO  MRAC  schemes  comparable 
to  SISO  MRAC  schemes  in  term  of  applicability  and  properties. 

In  chapter  3,  it  was  shown  that  identifiable  parameterizations  for  direct  and  indirect  adap¬ 
tive  schemes  require  the  knowledge  of  the  observability  indices  or  a  set  of  pseudo-observability 
indices.  If  the  system  is  unknown  it  is  likely  that  this  type  of  knowledge  is  not  available.  This 
has  lead  researchers  to  investigate  structure  estimation  techniques.  Recent  contributions  in  the 
domain  are  by,  e.g.,  Wertz  et  al.  [S3],  Van  Overbeek  k  Ljung  [84],  Hannan  k  Kavalieris  [85], 
Eldem  k  Yildizbayrak  [86],  Janssen  ct  al.  [87],  and  Fuchs  [88].  More  particularly.  Van  Overbeek 
k  Ljung  [84]  have  discussed  the  advantages  of  using  overlapping  parameterizations  (parameter¬ 
izations  based  on  the  pseudo-observability  indices)  for  structure  estimation,  assuming  that  the 
order  of  the  system  is  known.  They  also  showed  the  feasibility  of  an  on-line  structure  estimation 

procedure. 

In  the  previous  chapter,  we  extended  the  results  of  de  Mathelin  k  Bodson  [65]  about  param¬ 
eter  convergence  in  recursive  identification  rvith  canonical  structures  to  recursive  identification 
with  pscudo-canonical  structures,  and  found  frequency-domain  conditions  to  guarantee  the  con¬ 
vergence  of  the  parameters,  assuming  that  the  selected  structure  is  a  valid  one  (see  Theorems 
3  4  a.,nd  3.5).  In  this  chapter,  we  reverse  the  problem  and,  assuming  that  sufficient  excitation 
is  provided,  we  find  conditions  to  guarantee  that  the  structure  is  indeed  valid.  The  results  are 
related  to  those  of  Van  Overbeek  k  Ljung  [84].  The  main  difference  is  that  we  express  minimal 
conditions  on  the  reference  inputs  using  frequency-domain  conditions  (white  noise  inpuffi  are 
not  required).  Also,  we  extend  the  results  to  incorporate  the  case  when  the  order  itself  is  not 
known.  The  analysis  is  carried  out  in  parallel  between  the  canonical  and  pseudo-canonical 
forms,  allowing  for  a  comparison  of  their  respective  advantages.  These  results  could  be  used 
for  structure  selection  in  an  indirect  adaptive  scheme.  Finally,  note  that  these  results  were  also 
detailed  in  de  Mathelin  k  Bodson  [89]. 

5.1  Structural  adaptation  in  MRAC 

5.1.1  Control  algorithm 

Tlie  following  controller  structure  is  considered 

r  Mo[ro] 

U  =  I(G[r]  +  K-^C[u]  +  A-^D[y,]  (5-1) 
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where  A{s),C(s),  D(s)J<{s)  6  6’(5)  and  Mo{s)  €  Mo{s)  is  a  proper  stable 

transfer  function  matrix,  G{s)  is  a  proper  stable  transfer  matrix  such  that  KG  is  proper,  and 
A(s)  is  a  Hurwitz  diagonal  matrix,  A(s)  =  diag{A:-(s)},  such  that  A~^C  and  A~^D  are  proper. 
Since  A~^C  is  proper,  one  must  still  use  for  implementation  the  following  equivalent  control 
law 

U  =  {Co)-\KG[r]  +  A-^{C  -  Aa^)[u]  +  A-^D[y,])  (5.2) 

where 

Co  =  lirn  A  3-nd  Co  =  /  —  Oooo  (^-3) 

°°  5— +00 

By  combining  the  equation  of  the  plant,  7/p  =  P[u],  with  the  equation  of  the  controller  (5.1), 
the  output  Up  can  be  expressed  as 

!/p  =  AA((A  -  C)Dn  -  DNRr^AKG[r]  (5.4) 


where  {Nr,  Dr]  is  a  right  MFD  of  P{s). 

Assumptions 

(Al)  Plant  assumptions 

The  plant  is  described  by  a  square,  nonsingular,  strictly  proper,  and  minimum  phase 
transfer  function  matrix  P{s)  £  3Rp^p(s). 


(A2)  Adodel  assumptions 

The  reference  model  d/(s)  =  C(s)d/o(s),  where  G(s)  is  a  diagonal  ma-trix,  G{s)  ~ 
diag{^7Pyr}  with  a  >  0  and  d;  =  “  1))  +  where  the  integers  {r,}  are  the  rela¬ 

tive  degrees  of  the  diagonal  elements  of  the  Hermite  normal  form  of  P{s)  (see  Dchninor. 
1.4),  and  A/o(s)  G  3i"'^^(s)  is  a  proper  stable  transfer  function  matrix. 


(A3)  Reference  input  assumptions 

The  reference  input,  ro(<),  is  piecewise  continuous  and  belongs  to  L  OO  Vt  >  0. 

The  model  output,  7jm,  is  denned  as: 


ym  =  GMo[ro]  =  G[t] 


(5.5) 


Note  that,  from  assumption  (A2),  based  on  the  definition  of  the  Hermite  normal  form  and  of 
the  interactor  matrix  (c/.  Definition  1.4),  we  have  that  H~^G  =  ^G  is  a  proper,  stable,  and 
miniinurn  phase  transfer  function  rnalrix. 


Proposition  5.1  :  Extended  model  reference  matching  equality 

If  DA.  =  I/-1  and  ;/  >  3  EE'S),  D-{s),  K‘  €  solution  of  the  Diophantine  equation: 

Nr{{A  -  C')Dr  -  D‘Nr]-P\IGG  =  G  (5.G) 
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such  that  model  matching  is  achieved  (the  transfer  function  from  r  to  is  G(^)),  A  ^C’  and 
A-i D*  are  proper.  In  particular,  I  -  =  Q  =  Kp  nonsingular,  K'  =  H  ^  =  (S’F  +  /)  A, 

db^  <  -  1,  and  dTiC*  <  dXi. 

Proof  •  /  \  •  •  T 

The  proof  is  similar  to  the  proof  of  Proposition  2.1.  The  matching  equality  (5.6)  is  equivalent 

K*P  =  /  -  A“^C*  -  A~^b*P  (5-7) 

Now,  let  {Al,  Dl}  be  a  left  coprime  MFD  of  P(s)  with  Dl  row  reduced.  Using  the  polynomial 
matrix  division  lemma  (Lemma  2.2),  divide  AP"^  on  the  right  by  Dl,  then  3  Q{s),  Rb)  G 
such  that 

A//-1  =  QDl  +  R  and  RDl^  is  strictly  proper 

and  dc,R  <  dc^Dc  <  Using  Definition  1.4,  let 

D’ ^  ~R  =  QDl- C'^X-QNl  /C*  =  A"' =  (S*F  + /)A 

then,  it  can  be  easily  verified  that  the  given  C',  b%  and  IC  solve  the  matching  equality  (5.7). 
Furthermore,  since  dXi  =  v  —  I,  A~^D'  is  proper.  On  the  other  hand, 

lin,  A--C-  =  C„-  =I-Ci=  Vun  A-' D-P)  =  r-IL 

s— >00 

so  lhat  is  proper  and  dr,C"  <  oX,,  r.y.,  dr^C  r',„ax  —  1  ir  <9A,  —  r^n-xx  1- 


□ 


5.1.2  Adaptation 

The  matching  equality  (5.6)  is  equivalent  to  (c/.  Proposition  5.1) 

/  =  (S'F  +  /)AP  +  A-^C’  +  A^^D^P 


(5.8) 


Define  L{s)  =  diag{/(s)},  with  /(s)  Hurwitz,  dl{s)  ^  d  >  R  -  ^))  +3, 

largest  possible  degree  of  all  elements  of  -  i{s)).  Then,  multiplying  both  sides  of  (5.  ) 

by  5“^  and  applying  both  transfer  function  matrices  to  u  leads  to 


L-^/A[yp]  =  L-\P‘FA[y,\  T  A-'(C‘  -  A)[u]  +  A  'F*[yp]) 


(5.9) 


which  is  an  equation  whore  the  unknown  parameters  appear  linearly.  From  Definition  1.4,  S 
is  such  that 


.  .  _  /  0  if  Z  <  J 

~  1  0  or  o-.y(.s)  if  i  >  j  with  <  (EI-=i+i(^7  -  1))  -  1 


(5.10) 
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(9c, E*  <  (  ^  [rk  —  1))  -  1  =  —  (n  +  1)  V  z  —  1, . .  -  ,p  1 

i=i4-l 

Therefore,  from  Proposition  5.1,  there  exist  matrices  Cj , . . . ,  ,■■■■,  D ^  G  3?^  matrices 

SI,  ...,  E,;_1  €  E;^,  ...,  e  e  such  that 

1  -  5(-i)  -  1  -  s('-P 

(AL)“^((7'‘ -  A)  =  -  ~^ol7T\  +  ■ 


'l{s)  n{s)\{s) 


l{s)  ’  Ks)A(s) 

(AL)-'i)-  =  5:^  +  |:A'y^ 

r-'s-r-A  =  "g' s- AEii±ArA(s) 

where  T‘  is  made  of  the  j  first  rows  of  the  p  x  p  identity  matrix  if  Yll-j+i  {vk  -  1)  < 
Furthermore,  given  (5.10),  several  elements  of  the  matrices  S*  will  always  be  identical  to  zeio. 
For  example,  if  p  ==  3,  ri  —  1,  r2  —  2,  and  —  3, 


*^1  “ 


V- 


V*  — 
^3  — 


'  0 

0 

2: 

0 

X 

X 

■  0 

0 

0 

0 

X 

X 

■  0 

1 

0 

X 

and  = 


1  0  0 
0  1  0 


and  T-  =  r 


'2 


md  2^"  =  [  1  0  0  ] 


where  x  indicates  a  possibly  nonzero  element.  The  matrix  of  unknown  controller  parameters  is 

0-"  =[Ci  ...  c;_,  D\  ...  DI  s;  ... 

and  the  regressor  vector 

si^-\KL)-^[uY  {i\L)-^[ypV  5(‘'-2)(AL)-M2/pr 

L-^[y,Y  T'A-'FA[yp]^  ...  L-iFA[yp]^  ' 

so  that  (5.9)  can  be  rewritten  as 


Then  the  following  error  equation  can  be  derived 


£.,  =  +  i-'AljJ  =  (»’■  -  0-")4-  = 


(.5.11) 

(5.12) 

(5.13) 
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where  9  is  the  estimate  of  0*  and  <f>  is  the  parameter  error.  We  will  use  the  normalized  least- 
squares  algorithm  with  covariance  resetting  of  section  2.4  to  estimate  B. 

The  error  equation  requires  the  a  priori  knowledge  of  the  relative  degrees  {r,}  of  the  diagona 
elements  of  the  Hermite  normal  form  and  an  upper  bound  r/  on  the  observability  index  i/n^ax- 

5.1.3  Parameter  transformation  and  error  formulation 

Given  the  control  law  (5.2),  the  matrix  of  estimated  parameters  Co  must  avoid  singularity. 
Therefore,  the  parameter  transformation  (4.18)  and  (4.19)  described  m  Chapter  4  will  be  imple¬ 
mented.  The  controller  parameters  will  be  denoted  9^  and  will  be  obtained  from  the  estimated 
parameters  9  through  the  parameter  transformation  (4.18)  and  (4.19)_(assuming  that  cr  is  a 
lower  bound  on  \Kp\  instead  of  an  upper  bound  as  in  Chapter  4,  since  Co  is  the  estirnate  of  Ap 
instead  of  of  Kp^).  As  explained  in  Chapter  4,  9c{t)  will  be  equal  to  0{t)  as  long  as  Co(0  is  far 

from  singularity. 

For  the  purpose  of  analyzing  stability,  we  will  now  represent  the  adaptive  system  in  terms 
of  its  deviation  with  respect  to  the  ideal  situation  when  (f>  =  0.  Given  the  definition  of  the 
controller  parameter  matrix  9^,  the  control  law  (5.2)  is  rewiitten  as 

u  =  Co^^iI<G[r]  +  9jib)  =  -h  -f  9j w)  (5.14) 

where  9c  and  9c  are  submatrices  of  9c 

C  =  i  Co  9'^  9'^  1 

-  c  ^  ^  Uc  c  O  J 


and  w  and  are  defined  as 


-T 

W  = 

vjGG  w^y 

T 

Vp  \ 

"A 

II 

■  ... 

II 

Sh 

1 

CN 

1 

(2)^ 

[a-' for  -- 

1  =  r4<=),.fol^ 

(3)^  i 

’  T^FAG[rY' 

s(A-n-i)rA-.FAG[rP  1  =  H  G[rr  = 

i/rn 

where  the  transfer  function  matrices  are  strictly  proper  and 

transfer  function  matrix  H  (n  G  is  proper  and  stable,  hrorn  the  control 

ym 

following  relationship  can  be  deduced 

stable  and  the 
law  (5.14),  the 

- 

]  =  -AC[7']  =  -CoU  -V  9jvul^^  +  Ojw  =  ejw 

(5.16) 

where 

^  -vG  vP- 

(5.17) 

124 


If  we  define  the  signal  r-p  as 


(5.18) 


rp  =  H  ^[j/p] 

then,  the  matching  equality  (5.8)  applied  to  u  can  be  rewritten  as 

Cou  -  A[yp]  +  E-FA[yp]  +  ^  r,  + 

If  we  define  the  control  error^  ec,  as 

Cc  =  {oj  -  0*^)w  =  (flw 

Then,  from  equations  (5.16)  and  (5.18) 

Cc  —  Tp  —  AG[7']  —  0’  =  7’p  —  (A  +  d'  H^(3)^^)G[t]  =  I'p  —  H  G[rj 

and  the  output  error,  cq  —  Pp  —  Pm,  can  be  e.xpressed  as 

eo  =  H[rp]  -  G[r]  =  =  H[c,] 

Since  7/p  =  P[u\  =  H[rp],  the  control  input  can  also  be  expressed  in  terms  of  the  control  error 
as 

u  =  p-^H[rp]  =  p-^G[r]^  p-^H[e,] 

Similarly, 


(5.19) 


(5.20) 


■  lAh  1 

1 - 

? 

1 

^  yp  j 

H 

r 

-ip- 

^  1 

[Cp]  ^  /Trrp[^’p] 


f  n  1  1 


^  >  Up 

L-^ 


(3) 

m  Vm 


[i/p]  ~  ^i’yp\yA  ■”  (5.22) 


where  the  transfer  function  matrices  are  stable  and  strictly  proper  and  stable,  and 


Pfxjjyp  is  stable  a,nd  proper.  If  we  define  the  model  signals,  ^’m,  as  the  signals  v  v>hen  b  —  0 


d’.u  =  Pxi>yp[y7nl  =  H,!:y.,G[r]  =  i/,/,^r[?'] 
then,  we  can  define  the  regressor  error,  e^;,,  as 

ev-  =  V'  -  hhn  =  lUvpi^o]  -  PTpTpiec] 


(5.2-1 ) 
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5.1.4  Stability 

The  following  theorem  is  the  main  stability  theorem.  It  shows  that  given  any  initial  condition 
and  any  bounded  input  r(t),  the  states  of  the  adaptive  system  remain  bounded  and  the  output 
error  converges  to  zero  as  t  — >■  oo.  Furthermore,  the  difference  between  the  regressor  vector  ^ 
and  the  corresponding  model  vector  ■i/’m  converges  to  zero  as  t  co. 

Theorem  5.1  ;  Global  stability  of  the  extended  direct  MRAC  system  -  /vp  unknown 


Consider  the  MIMO  MRAC  system  described  in  Section  5.1.2  Assume  that  the  parameter 
estimation  algorithm  (2.29)  and  the  hysteresis  transformation  (4.18)  and  (4.19)  are  used.  If  the 
reference  input  r  €  Loo  and  is  piecewise  continuous,  then 

•  All  states  of  the  adaptive  system  are  bounded  functions  of  time. 

•  The  output  error  cq  =  Vp  —  y,n  €  L^o  3-cid  limt_^oo  co  =  0- 

•  The  regressor  error  —  ip  ~  G  Loo  f'-rid  lim(_^oo  Ci/-  =  0- 

For  the  stability  proof,  we  follow  similar  steps  as  for  the  proof  of  Theorem  4.1. 


Proof  of  Theorem  5.1 


A.  .'Ml  signals  belong  to  Z.^oe 

Similarly,  to  section  4.3.2,  it  can  be  shown  that  (^yp^w^ 
(id,  w,  u,  Tp)  belong  to  Tcoe- 


belong  to  Lcoe  and,  therefore, 


B.  Ip  is  regular  and  all  signals  are  bounded  by  |['0f||co 

Let  .'c,x,fR+  e  Looe-  Then,  we  say  x  is  regular 'Ll  3/:i,fc2  >  0  such  that 


i(0i  —  Ibdloo  +  ^2 


Recall  from  (5.19)  and  (5.14)  that 


r 


V 


CqU  -  Ofw 

CoCo-:KG[r]  +  -  df)w 


(5.25) 


and  from  (5.21),  that 


la  —  Llmrplj'p 


with  Stable  and  strictly  proper.  Therefore,  applying  Lemma  4.4 


llb’l 

< 

+  b(OI  ^  Ib-’illoo  +  k 

d 

—  u; 
dt 

< 

^iiF'illoo  +  ^ 
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for  some  constant  k  >  0  and  where  e  is  an  exponentially  decreasing  term.  Again  we  use  the 
single  symbol  k,  whenever  an  inequality  is  v'alid  for  some  positive  constant.  Therefore,  w  is 
regular.  Now,  recall  from  (4.27)  that 

■0  =  7/0rp[^p] 


with  strictly  proper  and  stable.  Therefore,  by  applying  Lemma  4.4 


101  <  ^'IkpJloo  +  l£(01  ^  ^ 

101  <  Ll|F-^[r,],|U  +  |0O!  (5-26) 

I’T'^l  -  +  le(OI  < 

at 

Now,  define  0  as  /-^[ro].  Since  w  is  regular,  /“*  is  strictly  proper  and  minimum  phase,  by 
applying  Lemma  4.5 

|A’|  <  ^i|0i||co -b 


Since 


10!  £  10! 


0 


\ii\  <  /:|j0illoc.  “r  -t 


I ;  V  M I 


so  that  tj)  is  regular.  Now,  from  (5.25) 

l^pl  ^  ^|u'|  +  k  <  k\\'ih 


Similarly,  from  (5.14) 


I  Til  ^  k\iu\  4“  k  ^  ^|j'0f|!co  "h  k 


and  applying  Lemma  4.4  to  j/p  =  PW] 


l!/,l  <  (--IIAllo,  +  t' 


Consequently, 


■'^l,  l!/pl>  l^'pl^  0-0  00  £  ''^'llFillco  + 


and  if  0  is  proved  to  be  bounded,  then  all  signals  will  be  bounded. 


C.  liini_oo  /Sc  =  0 
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This  comes  from  the  regularity  of  The  proof  is  identical  to  Part  C  in  the  proof  of  Theorem 

4.1. 

D,  Relationship  between  output  error  and  identification  error 
Recall  from  equation  (5.20)  that 

eo  =  yp-ym=^ 

therefore,  from  (5.15),  (5.17),  and  (5.22) 

{HL)-^[eo]  =  Z,-'(E*T  +  /)A)[eo] 


which  can  be  rewritten 


+  A)L-'[eo]  =  + 


(5.27) 


Now,  this  can  be  used  to  transfer  convergence  properties  from  the  identifier  error  to  the  output 


error. 

E.  All  signals  arc  bounded,  lim-^co  £o  =  0;  limt^eo  cy-  —  0 
Suppose  that  {A.  B.C}  is  a  minimal  realization  of  /"H'S),  hc-; 
and  11^  such  that 


C{sl  -  Ay^B  =  B^{s).  Let  X 


X  =  Ax  +  Bw'^Cpc 

IT  =  AW  +  Bu/ 


then 


Cx  =  I  '^[w'^(pc 

cw  =  i~^[wy 


SO  that 


irthermore,  \/t  ^  T  ~  {?!/;}  U  {-Ik}  U  i'^k}  U 


r 


^(,r  -  ll'<Pe)  =  41(3:  -  wy)  - 


where  V/  ^  T 


d 

Jt 


y  =  <^  +  PQ  +  PQ 


(5.28) 


(5.29) 


(5.30) 
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and  Wt^r 

f  0  if  Tfc  <  f  <  ifc+i 


■s^+sPAP^Prr'pj''’*:tZif^Q  -  PAPjp.r'ci  if 


tk<t<TkVk 

CTrruniPj {i))  > 


[  0  otherwise 


Define  (  such  that 


Q  if 


c  = 


tk<t<  Tk  V^- 


Cfi 


0  otherwise 


Then,  given  the  properties  of  the  identifier  (c/.  Lemma  2.3)  when  'S  not  SE,  given 

the  fact  that  3  T  >  0  such  that  Co^t)  —  Co(t)  and  (’(t)  =  0  V  i  >  T  when  SE,  and 

given  the  fact  that  (P^Pj,)-^  is  bounded  if  >  ep,  C  €  H  L^.  Given  the  definition 

of  G  from  (5.30) 

^4>,  =  <^  +  PQ  +  C  Vf^r  (5.31) 

at 

D  cfi  n e  A  7’^  j  ^  r;t '  ^  i  ^  z  'y 

=  ('?c)i<=r.  -■  (f'=)|(=7'' 

A,  =  -(4);,..- 

A, 4  =  (<?^c)p.^*  -  (5-32) 


Finally,  combining  together  (5.27),  (5.28),  (5.29),  (5.31),  and  (5.32) 

{9^H  +A)L-^[eo]  -  +  {Ce^\x  -  W(l),)\t=of 

-( f  C’e^(‘-^)lE(r)(<^(r)  +  P(r)Q(T)  +  C{r))drf 

-(^  Ge^('-^'=nE(n)AT,s(t  -  Tfc))"' 

Tk<l 

-(E  Ce^^^-^^hV{Tk)ArAi  - 

-(  x:  Ce^<‘-'y  s((  -  (‘0)’'  (5-33) 


where  s(t)  is  the  unit  step  function.  By  Lemma  4.4,  liy|  <  A;||rUi||co  +  k(01  ^  Z;||T/f(l|oo  +  k. 
Since  (d  +  PQ  +  C)  ^  To  H  Leo,  Lemma  4.6  can  be  applied.  Further,  {Tk}  and  {<oy}  are  finite 
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sets,  and  =  4,  +  z6,,  V  z.  Also,  if  is  SE,  3  >  0  such  that  A.,  =  0,  V  k>  I-  , 

and  {tM  is  a  finite  set.  If  /^^yrTT  is  not  SE,  then  {r,}  is  a  finite  set,  lim,_oo  ^^(0  -  ^co, 
limt^oo  Pit)  =  Poo,  and,  from  Lemma  4.2,  lim.^c  [A.^J  =  0.  Therefore,  similarly  to  Part  E  in 
the  proof  of  Theorem  4.1,  (5.33)  may  be  put  under  the  following  form 

{ejH  (3)  +  A)L-Meo]  =  hi  +  UtWoo)  (5-34) 

with  lim^_oo  =  0.  From  (5.25)  and  (5.26) 


Ut 


F’"^[rp]|  <  A:||u;(||oo  +  k  <  A:||V’(||oo  +  k  <  A:||F  ^[rp](|[oo  + 


(5.35) 


so  that  is  Since  Vp  =  FJiF-'hl,  with  FH  stable,  proper,  and  minimum  phase, 

applying  Lemma  4.5  . 

lF“^[7'p]l  <  ^'ilj/prlico  +  ^  ^  ^Ikorlloo  +  ^  i'^'  ^ 

By  applying  Lemma  4.4  to  (5.20) 

l^eol  <  kllzclU  +  KOI 
at 


Col  <  k\\F  ’[rpliijco  +  k  <  /;i|eo,l|co  +  k 


Then,  from  (5.35)  and  (5.3G) 

.  d 
dt 

so  that  eo  is  regular.  Therefore,  since  I"’  is  stable,  strictly  proper,  and  minimum  phase,  using 

Lemma  4.5  „_s 

|eo|  <  [eo]i||co  +  ^  ) 

Lgj.  y  _  (3)  +  A)L“^[eo].  Then,  from  Sections  5.1.1  and  5.1.2,  v  has  the  following 

structure 


(5  +  a) 


7*1 


1(3) 


-[eoil 


r2-2 


t‘=0 

r2H"r3  -3 


Cb  =  E  E,„„„ 

1=0 


l{s) 

s'(s  + 


l{s) 

r3-2 


l{s) 


(fo,]  +  L  ^'c3„3(.) 


1=0 


l{s) 


-[eoj]  + 


(.?  +  aY^  r  , 


Vp  — 


di  -(ri  +  1) 

V  F 

^  ^pjpl(‘) 


■/  Wj-fl  C^2-(^2+l)  -h  1 


{-0 


l{s) 


i-0 


lis) 


l{s) 
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wheie  jki{i)  is  the  position  in  the  k-t\i  row  of  Oj  of  the  estimate  of  the  coefficient  of  f-th  power  in 
crki{s).  Then,  after  applying  the  linear  operator  to  the  z-th  element  of  u  for  {  =  1, . . .  ,p, 

using  Lemma  4.4  and  (5.37)  yield 

<  A:i|t;iJU  +  lc(0| 

K  ^[^02)1  ^  ^||e0ij|oo  +  ^||t^2t|lco  +  |€(0I  —  ^ll'^ltlloo  ffi  ^ll^2t||oo  +  ^ 

K  ^  ^ll^DiJIoo  +  ^||'202j|oo  +  ^11^3, ||co  +  1^(01  —  Iloo  "i"  ^11^2,  ||oo  +  ^11^3,  Iloo  +  ^ 


|f  M^Opll  <  ^l|eOjJ|co  +  •  •  •  +  ^■iieO(p_,)J|oo  +  ^'||UpJlco  +  |e(0l  ^  ^il^lclloo  +  •  •  •  +  ^ii^P<il<»  +  ^' 


Therefore, 


|L-*[eo]|</^-b.|U  +  ^'  (5.39) 

Combining  (5.26),  (5.36),  and  (5.37)  yields 

101  <  ^||rp,||co  +  1^(01  —  ^ikoillco  +  k  <  k\\L  ^[eo](||co  +  k  (5.40) 

Then,  from  (5.34),  (5.39)  and  (5.40),  it  can  be  deduced  that 

l^'i  <  |,d|(l  +  l|0(||co)  <  +  ||l^tl|oo)  (5.41) 

In  this  expression,  lim^^co  d  =  0.  Consequently,  3T  >  0  such  that  V<  >  T,  k\3{t)\  <  1.  Tlicn 


|i'(0!<^ikTlU  +  A;  vt>T 

This  can  be  interpreted  as  an  application  of  the  small  gain  theorem  (c/.  Sastry  Bodson  [3], 
pp.  149).  Since  v  6  Lccc,  it  follows  that  i>  G  L^.  Then,  from  (5.41) 

Ini  <  ^'|^i 

Therefore,  lim(_co 'u  =  0.  From  (5.39),  it  follows  that  T“^[eo]  G  Too-  Therefore,  from  (5.40), 
0  G  Loo  and  all  signals  in  the  adaptive  system  are  bounded.  Since,  eo  is  regular,  cq  G  Leo- 
Given  the  value  of  the  first  element  of  v  {cf.  (5.38)),  we  have  that  G  Loo  and 

limi-»oo  ~t(7j~[^0i]  =  0.  Then,  from  Lemma  4.7,  limj_oo  eo,  =  0.  Given  the  value  of  the 
second  element  of  v  {cf.  (5.38)),  applying  Lemma  4.6  we  have  that  G  Loo  and 

limf_oo  ^^](°)  ^  ~  Then,  from  Lemma  4.7,  lim(_oo  =  0.  Similarly,  it  can  be  shown 

that  lim(_co  eo.  =  0,  z  =  3,...,p,  so  that  lim(^oo  Cq  =  0.  Finally,  since  e^,  =  H^.y^leo]  {cf. 
(5.24))  with  stable  and  proper,  by  Lemma  4.6,  wc  have  that  Cy,  G  l-co  and  c^,  —  C. 

□ 


Finally,  note  that  as  in  Theorem  4.1  there  are  no  requirements  on  the  reference  signals  ?■ 
except,  of  course,  that  they  must  be  bounded  and  piecewise  continuous. 
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5.2  Structure  selection  in  recursive  identification 

In  section  3.2.3,  we  assumed  that  the  observability  indices  or  a  set  of  pseudo-observability 
indices  were  known  to  derive  a  recursive  identifier  for  an  identifiable  parameterization.  If  this 
knowledge  is  not  available,  we  would  like  to  know  how  to  assess  if  a  correct  or  incorrect  structure 
has  been  selected.  In  this  section,  we  show  how  the  autocorrelation  of  the  regressor  vector  ^ 
can  be  used  as  a  criteria  for  structure  selection.  The  main  results  reside  in  the  following  two 
theorems. 

Theorem  5.2  Structure  selection  -  Identification  of  pseudo-canonical  left  MFD 
Given  a  strictly  proper  stable  multivariable  system  with  unknown  pseudo-observabilit}'  indices. 
Assume  that  the  inputs  are  sufficicnth^  rich  for  identification  of  the  S3^stem  (for  example,  assume 
that  the  sufficient  condition  of  Theorem  3.5  is  respected). 

1.  Let  the  true  system  be  of  order  n,  the  structure  defined  by  the  pseudo-observability  indices 
{p,}  with  Pi  =  71  is  a  valid  structure  if  and  only  if 

/?^(0)  >  0 


2 


where  the  regressor  is  given  by  (3.11). 

The  structure  defined  by  the  pseudo-observability  indices  {p^}  is  a  valid  structure  if  and 
only  if 

/?^(0)  >  0  and  (0)  =  0  V7“l,.-.,p 

v/here  ib  is  e'iven  bv  (3-11)  and  w;  is  the  augmented  vector 

[  V’  1 


IL'i 


Proof 
Part  1: 

First,  let  us  show  that  if  the  set  of  indices  {/5.}  defines  a  valid  structure  of  order  n  then 
P,i,(0)  >  0.  Suppose  it  was  not  true.  Then  there  would  exist  a  vector  k  €  ^  I-  ^  0 

such  that  k'^R,i,{0)  =  [0].  Since  the  input  is  sufficiently  rich  (by  having,  for  example,  n  + 
distinct  treciucncy  components  per  input),  this  is  equivalent  to: 

k'^H.,.,,{.s)  =  [0]  Vs  (5.42) 
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where  H-^u{s)  is  the  transfer  function  between  the  input  u  and  the  regressor  vector 


H4'u{s)  = 


{s+a) 


(5  + a)^ax 

0 


0 

1 


(s+a) 


0 

0 


(s+a)'’ 


0 

Ai(^) 


0 

_Pn(s) 


— /’l  +  '  (i+a)'’"’^’'  Pl+' 

Puis)  ^■^(^1- 


P2AS) 


(s  +  a)'^''’”' 

JMfL 


Pp.Js) 


PrAs) 


(s  +  a) 

1 

Plrn(s) 

f’lm(s) 

(5  +  a)^nax 
/^2m(5) 

Pvm(s) 


(5.43) 


N  _  ^ivr'T  1  nP-.\  n  siirb  +b,'>t  fn  42')  can  be  rewritten  a.s 

Therefore,  3  A  (5)  t  V[i)  c  4l  ■  [Sj,  r  si+.r.  ....... 

r  T  -1  [  <  Pi 

N{s)  -  D{s)Pis)  =  [0]  v.uth  ^ 


Define  ( Nr(s)  Dl(s)}  as  the  pseudo-canonical  left  MFD  with  pseudo-observability  indices  {p.}. 
Then  {Nl{1),Dl{s)}  is  unique  and  AT(s)  -  Dp{s)P{s)  =  0.  Now,  define  {Nl{s),  Dl{s)}  such 

that 

[iYL(s)  Dl{s)]^  =  Wds)  DlIs)];  if  Pt  T  dmax 

=  [Nl{s)  DL{sd  +  [N{s)  D{s)]  if  p.  -/Imax 

where  1  ],  is  U.c  r-lh  row  of  the  matrix  [  ].  TI.erefore,  {A'a(s),  DUs))  is  another  pseudo- 

canonical  form  with  pseudo-observability  indices  [p,],  which  is  impossible. 

The  next  step  consists  in  showing  that  if  l?o.(0)  >  0  then  the  set  of  indices  {p,}  dennes  a 
valid  structure  or,  equivalently,  if  the  {p.}  are  not  a  valid  set  of  pseudombservabihty  indices 
then  R,M  =  0.  Suppose  that  (p.)  is  not  a  valid  set  of  pseudo-observability  indices  then  tlun-e 
must  exist  an  index  1.  1  <  I  <  P  such  that,  for  all  state-space  realizations  {A,B,C}  of 
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system,  the  matrix  /v[C,  A] 


(  nun{pi,pi  +  1)  if  i  f 

with  r,-  =  <  mmlpi,pi)  if  z  >  /  (5.44) 

i  pi  <  Pl-'^ 


has  full  rank  r  =  XiLi  f>ut  such  that  the  row  vector  C;A^'  is  linearly  dependent  on  the  rows 
of  the  matrix  K[C,A],  i.e.,  ^ 

CiA^‘  =  E  E  ^UkCjA'^ 

Since  K[C,A]  has  full  rank  r,  there  must  exist  a  set  of  pseudo-observability  indices  {p.}  such 
that 


K[C,A]  = 


Cl 

C2 


Pi 

> 

min(p.-,p/  + 

1)  if  i<l 

pi 

> 

min(p.,p/) 

if  i  >  1 

pi 

< 

pi  -  1 

Suppose  that  {Nl{s) ,  Dl(s)}  is  the  pseudo-canonical  left  MFD  corresponding  to  the  indices 
{pi}.  Then,  the  /-th  row  of  Dl{s)  is  such  that  (c/.  Definition  1.12) 


dDf., 


<  r,  if  I  ^  I 
=  pi  if  i  =  I 


BDlu  <  Pi  Vz 


and,  since 

-  Dli{s)P{s)  —  0 

given  the  definition  of  H,pu{s)  (5.43), 

3  it  G  ,  A;  7^  0  such  that  k^H^,u{s)  =  [0]  Vs  =>  R4,-u{0)  —  0 


sot  of 


Part  2;  .  r  >  r  ...r  j 

Usinf  the  same  technique  tlian  in  Part  1,  it  can  be  shown  that  if  the  \p,)  iunii  i. 

pseuE-observability  indices  then  A^^O)  >  0  if  the  inputs  are  sufficiently  rich.  Furthermori^, 

since  z/p  =  there  exist  p  vectors  k,  ^  0  such  that  kfwi  —  0,  so  that  A,,,,(0)  -  0  Vz  - 


As  in  Part  1,  the  next  step  consist  in  proving  that  if  the  {p,}  are  not  a  valid  set  of  pseudo¬ 
observability  indices  then  /?,/,u(0)  =  0  or  3  z  such  tha.t  Au,,u(0)  >0.  If  {p,}  is  not  a  va  r 
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set  of  pseudo-observability  indices  then  only  two  different  situations  may  arise.  In  the  first 
situation,  there  exists  an  index  1  ^  ^  p  such  that,  for  all  state-space  realizations  {xl,  5,  C} 

of  the  system,  the  matrix  K[C^A]  as  defined  in  Part  1  (see  equation  (5.44)),  has  full  rank 
r  “  but  the  row  vector  CiA^^  is  linearly  dependent  on  the  rows  of  the  matrix  K[C^A]. 

Then,  similarly  to  Part  1,  it  can  be  shown  that  72^u(0)  =  0.  In  the  second  situation,  there  is  a 
valid  set  of  pseudo-observability  indices  {pi]  and  an  index  1  ^  I  ^  p,  such  that 

„  f  >  p/  if  z  =  / 

Pi  if  f  f 

Then,  it  can  be  shown  that  >  0.  Indeed,  suppose  it  was  not  true.  There  would  exist  a 
vector  it  7^  0  such  that  k'^R^^{0)  =  [0]  or,  since  the  input  is  assumed  to  be  sufficiently  rich, 
such  that  =  [0],  Vs,  where  is  given  by 

R  ijj  u  ( *s ) 

Pn  (d  .  .  .  Pl,n{^) 

(5_|.a)A^nix -PI 

In  other  words,  there  would  exist  N{s)  G  D{s)  E  such  that 

f  dc.D  <  Pi  i  ^  / 

A^(s)  -  D{s)P{s)  =  [0]  and  i  dc,D  <  p, 

[  dN  < 

Let  {Nl{s),  Dl{s)}  be  the  pseudo-canonical  left  MFD  with  indices  {/),}.  Now  define  {AT(.s), 
R)  ( s  j  ^  such  t  it  a  t 

(A'uo  dl(s)]:  =  (waa  aaai.-  if  ‘V' 

=  liViW  aaoi.  +  |A'0)  a(s)j  .f  !  =  f 

Then  {Nl{P,Di{s)}  is  another  pseudo-canonical  form  with  pseudo-observability  indices  {/t,}, 
which  is  impossible.  □ 

Theorem  5.3  .•  Structure  selection  -  Identification  of  canonical  left  MFD 
Given  a  strictly  proper  stable  multivariable  system  with  unknown  observability  indices.  Assume 
that  the  inputs  are  sufficiently  rich  for  identification  of  the  system  (for  example,  assume  that 
the  sufficient  condition  of  Theorem  3.4  is  respected). 

d’he  structure  defined  by  the  observability  indices  {n,}  is  the  correct  structure  it  and  onh' 

if 

A0,(O)>O  and  i?,,,(0)-0  Vz  =  l,...,p 
where  V’,  is  given  by  (3.15)  and  tc,  is  the  augmented  vector 
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The  proof  of  Theorem  5.3  can  be  easily  deduced  from  the  proof  of  Theorem  5.2.  By  properly 
modifying  the  proof  of  Theorem  5.2,  Part  2,  it  can  be  shown  that,  assuming  sufficiently  rich 
inputs,  the  indices  are  the  observability  indices  of  the  system  if  and  only  if  >  0 

and  i2l..(0)  =  0  l,...,p. 

Remarks; 

In  Section  3.3.3,  we  had  found  conditions  to  guarantee  persistency  of  excitation  of  the 
regressor,  assuming  that  the  correct  structure  is  known.  Here,  we  have  reversed  the  question, 
and  asked  for  conditions  to  validate  the  structure,  assuming  that  the  input  is  sufficiently  rich 
to  guarantee  persistency  of  excitation  for  the  correct  structure. 

If  the  order  of  the  system  is  known,  the  pseudo-canonical  structure  has  some  advantages 
over  the  canonical  structure.  Indeed,  R^,{0)  alone  can  be  used  to  test  that  a  pseudo-canonical 
structure  has  been  chosen.  Not  only  is  >  0  for  the  correct  structure,  but  it  is  also  not 

positive  definite  for  incorrect  structure,  no  matter  how  rich  the  reference  input  is.  Another 
advantage  of  the  pseudo-canonical  parameterizations  is  the  fact  that  they  are  overlapping.  In 
the  sense  that  two  pseudo-canonical  parameterizations  of  same  order  define  two  overlapping 
classes  of  systems.  Consequently,  it  is  possible  to  change  structure  in  a  recursive  identification 
algorithm  without  losing  the  information  accumulated  in  the  parameter  estimates  (by  applying 
to  a  state-space  representation  of  the  estimated  system  a  similarity  transformation  from  the  old 
to  the  new  structure).  This  property  of  pseudo-canonical  structure  was  used  by  Van  Overbeek 
&;  Ljung  [84]  to  design  an  on-line  structure  selection  algorithm  for  multiv'ariable  stochastic 
systems  of  known  order  and  without  measurable  inputs. 

The  disadvantage  of  pseudo-canonical  forms  is  that  more  parameters  need  to  be  identified 
and  complex  constraints  must  be  added  in  the  identification  algorithm  to  guarantee  strict 
pioperness  of  the  estimate. 

Finally,  it  should  be  pointed  out  that  if  a  least-squares  algorithm  without  covariance  reset¬ 
ting  {ki  =  0)  and  without  normalization  (7  =  0)  is  used  for  identification  {cf.  Section  2.4), 
using  averaging  theory,  it  can  be  shown  that  the  covariance  matrix  P  of  the  least-squares  al¬ 
gorithm  converges  to  a  neighborhood  of  if  9  is  sufficiently  small,  so  that  P  can  be 

used  to  check  the  correctness  of  the  identifier  structure. 
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Chapter  6 
Conclusions 


6.1  Contributions 

This  thesis  presented  new  analytical  results  on  parameterization,  stability,  and  convergence  of 
multivariable  adaptive  control  systems.  It  also  showed  new  algorithms  to  relax  requirements 

on  a  priori  information.  ^ 

The  thesis  focused  on  direct  adaptive  control  algorithms  and  recursive  identification  a  go- 

rithms  for  deterministic  multivariable  systems.  A  first  contribution  was  the  modification  of 
current  algorithms  in  order  to  ensure  tlie  identifiability  of  the  paramcterizations.  A  conse¬ 
quence  of  using  identifiable  parameterizations  was  the  fact  that  exponential  convergence  coul 
be  guaranteed  under  persistency  of  excitation  conditions.  It  was  also  shown  ^^ro^gh  an  examp  e 
that  exponential  convergence  could  improve  robustness  to  noise  and  unmodeled  dynamics,  r 
MRAC  scheme  for  a  MIMO  system  with  some  small  output  noise  and  some  unmodeled  dynam¬ 
ics  was  stable  with  an  identifiable  controller,  but  became  unstable  with  an  overparameterized 

conhoUer^nd  derivation  of  frequency  domain  conditions  on  the  reference 

inputs  to  guarantee  parameter  convergence  in  direct  adaptive  control.  In  the  SJSO  MRAC  case, 
we  recovered  the  requirement  of  2n  frequencies  for  2n  parameters  and,  in  i n 

the  requirement  of  4n  -  2  frequencies  for  4n  -  2  parameters.  However,  in  the  MIMO  MRAC 
case,  the  necessary  and  sufficient  conditions  were  different.  When  the  sufficient  condition  was 
violated,  but  the  necessary  condition  was  not,  parameter  convergence  occurred  in  some  cases 
and  not  in  others.  Ifersistent  excilaiioii  was  not  only  dependent  on  the  numocr  o.  trequenej 
components,  but  also  on  their  location  and  on  the  specific  system.  Furthermore,  tor  the  same 
system  the  locations  of  the  frequency  components  that  guaranteed  parameter  convergence  were 
usually’different  between  MRAC  and  identification.  For  the  same  input  frequencies,  parameter 
convergence  might  occur  in  MRAC  and  not  in  identification,  and  vice  versa.  One  could  be 
tempted  to  speculate  that  parameter  convergence  in  the  MRAC  case  did  not  occur  when  some 
frequencies  were  eliminated  (filtered  out)  by  the  controller.  However,  convergence  sometimes 
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occurred  in  the  MRAC  and  not  in  the  identifier  and,  clearly,  frequencies  were  not  eliminated 
in  that  case. 

Frequency  domain  conditions  for  the  pole  placement  algorithm  were  also  obtained.  Again, 
it  was  found  that  the  convergence  properties  were  different  from  the  MRAC  scheme,  or  the  re- 
cursive  identifier,  and  generally  more  frequency  components  more  required.  This  can  be  related 
to  the  fact  that  the  pole  placement  algorithm  required  as  much  as  twice  the  number  of  param¬ 
eters  necessary  to  estimate  in  the  MRAC  algorithm.  Since  no  practical  global  stability  result 
currently  exists  without  persistency  of  excitation  conditions  on  the  input,  the  only  advantage 
of  PPAC  resides  in  the  fact  that  it  can  be  used  with  nonminimum  phase  systems  when  MRAC 


Another  important  contribution  of  this  thesis  is  the  modification  of  MIMO  MRAC  algo¬ 
rithms  in  order  to  guarantee  stability  when  the  high-frequency  gain  matrix  is  unknown  (only 
an  upper  bound  or  a  lower  bound  on  the  norm  of  the  high-frequency  gam  matrix  and  an  upper 
bound  on  the  parameter  vector  are  required).  The  control  parameters  are  obtained  through 
a  particular  transformation  (a  sort  of  hysteresis)  applied  to  the  estimated  parameters.  The 
transformation  ensures  that  the  matrix  of  control  parameters  related  to  the  high-frequency 
gain  matrix  remains  nonsingular.  VVe  showed  that  all  signals  in  the  system  remain  bounded, 
that  the  output  error  and  the  regressor  error  converge  to  zero.  Furthermore,  the  hysteresis 
transformation  might  prove  useful  in  other  problems  where  singularity  regions  must  be  avoided 
such  as  in  pole  placement  and  nonlinear  control.  Another  contribution  is  the  fact  that  expo¬ 
nential  parameter  convergence  is  achieved  under  persistenc}"  of  excitation  conditions  when  an 
identifiable  parameterization  is  used.  .4n  example  proved  that  the  problem  of  the  singularity 
of  the  estimate  of  the  high-frequency  gain  matrix  was  more  than  a  mere  technicality  in  a  proof 
of  stability  (as  it  has  often  been  considered  in  the  literature).  Indeed,  a  MRAC  system  was 
shown  to  converge  with  the  hysteresis  transformation  implemented  but  failed  to  do  so  when 


the  transformation  was  not  present. 

Using  the  hysteresis  transformation  we  were  able  to  prove  global  stability  and  output  error 
convergence  for  a  MIMO  MRAC  scheme  requiring  less  a  priori  information  (only  the  relative 
degrees  of  the  diagonal  elements  of  the  Hermite  normal  form  and  an  upper  bound  on  the 
maximum  of  the  observability  indices). 

Finally,  we  compared  pseudo-canonical  and  canonical  input-output  models  for  the  identifi¬ 


cation  of  multivariable  systems.  Frequency  domain  conditions  for  parameter  convergence  were 
discussed,  assuming  a  priori  knowledge  of  the  structure  of  the  system  (the  observability  in¬ 
dices  in  the  canonical  case  and  pseudo-observability  indices  in  the  pseudo-canonical  case).  It 
was  shown  that  these  couditions  wore  almost  identical  between  pseudo-camomcal  and  canonical 
models.  It  was  also  shown  that  the  a  prion  knowledge  of  the  canonical  or  pseudo-canonical 
structure  of  the  system  is  necessary  to  define  an  identifiable  controller  parameterization  in 
MIMO  direct  adaptive  control.  Finally,  a  contribution  was  the  derivation  of  criteria  for  canon¬ 
ical  of  pseudo-canonical  structure  identification.  If  the  order  of  the  system  is  known,  identi¬ 
fication  of  pseudo-canonical  forms  can  be  more  efficient  since  no  information  is  lost  when  a 


138 


new  structure  is  selected.  However,  it  wa^  shown  that  if  the  order  is  unknown  this  advantage 
becomes  less  important  given  the  larger  number  of  parameters  to  estimate  and  given  the  fact 
that  constraints  must  be  added  to  the  estimation  algorithm  to  guarantee  strict  properness  of 

the  estimate. 


6.2  Directions  for  future  work 


There  exist  several  research  directions.  A  first  research  direction  consists  in  reducing  further 
the  required  a  pnon  knowledge  about  the  Hermite  normal  form.  Another  research  direction 
is  the  application  of  adaptive  control  techniques  to  reconfigurable  control  systems.  The  stud> 
of  the  robustness  properties  of  multivariable  adaptive  control  schemes  and  improvement 
of  these  properties  are  also  interesting  research  topics.  Current  stability  results  for  hill  ^ 
adaptive  pole  placement  schemes  are  very  limited.  Therefore,  looking  for  stronger  results  is 
a  possible  research  direction.  Finally,  to  apply  the  singularity  avoidance  algorithm  to  othei 
problems  requiring  a  similar  mechanism  is  a  promising  research  topic. 
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Appendix 


Proof  of  Lemma  2.3 


1.  We  note  that  V  f  ^  {r^  } 

dP-^  ^  ^ 

di  ^  1  +  ^ 

Since  the  right-hand  side  is  bounded,  £  Looe-  Further,  P~^{ii)  >  ^"^(^2),  Vij  >^2^0 
between  resettings.  At  the  resettings  P~^{Tk)  =  P“^(0).  Therefore,  P  ^{t)  >  P  ^(0)  =  /tq  / 
Vi  >  0,  and  0  <  P{t)  <  kol.  Then,  it  can  also  be  deduced  that  P,  ^ 

G  Too  • 

2.  The  smallest  possible  difference  between  Tf;^i  and  corresponds  to  Sr^.  =  0  and  a  variation 
of  X,n3.x{P)  =  cr„,ax(P)  Fom  ko  to  ki-  Given  the  continuity  of  o-n,ax(P)  in  the  elements  of  P  {cf. 
Definition  4.3) 

(ar+l  —  Tk)  >  {ko  —  ^'OIIPIIto 
o.  Ii  wc  cienne  itie  nyapuno'c  function  I  as 


G  =  tr(d^p-V)  >  0 


then  V  f  ^  {ri,} 


6^62 

\/  =  -g - 

1  +  'yip^Tp 


<  0 


Furthermore,  since  P  —  kg^ I  <  k^^  1  <  P  ) 


V(n)  <  r(rt-) 


It  follows  that 

0  <  y{t)  A  F(0)  =  /co'‘|p(0)|'  V7.  >  0 
and  since  P  G  it  can  be  deduced  that  (j),  d,  /?,  ^  -^oo- 


4. 


9^1  62 
+ 


dr 


upi-cM  +  Bia-u-vyr))  <  v(o) 

k 
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implies  that  €  L^.  Furthermore, 

P^P  ej 

^  =  ^l+^^T^y/2  (1  +7V’^t/-)i/2 

is  the  product  of  a  term  G  Loo  by  a  term  G  L^.  Consequently,  ^  G  L^l  Similarly, 

_  (1  +  ^2 

5.  Given  Definition  2.2,  if  jy+^:^WW^ 

rco  'ipTp'^ 

Va'>0  Bto^O  such  that  A,nin(  |  _|_  -y^T^  ~  ^ 


Further, 


p-i(0  =  ^'o"'^+  /  9 


ipib‘ 


-dr  'd  Tk  <t  <  Tk+i 


/r,  1  + 

Therefore,  if  «  =  g-^  [K^  -  then  3  T  >  0  such  that  no  more  than  one  covariance  resetting 

may  occur  after  T-  Consequently,  {n}  is  a  finite  set. 

Since  there  is  a  finite  number,  say  Afi,  of  covariance  resettings 

r^igtPLdr  =  F(o)  -  A'«)  +  i:(c(r„)  -  r(T,-))  <  (av-ow 

Jq  1  +  k=\ 


Consequently,  C  L2.  Similarly, 


and 


P  =  -g 


TT  = 


PlP 


y'^P 


(1  +  (1  + 

Pp) 


G  L, 


G  L, 


l  +  \Moo  (1+7^^^)'/^ 

Furthermore,  since  P  and  P  are  the  products  of  two  terms  G  L2,  using  Schwartz  mcquaht}  (c/. 

Desoer  k  Vidyasagar  [81],  pp.  232),  P  and  G  Lj.  r.,.  _  nf 

Finally,  V  vector  ,t,  define  the  function  lo^t)  =  x^P{t)x.  Then  V  t  >  (to  -  Uj 

0  <  w^{t)  <  /:o|2il' 

xJPxpp'^Px 

^-(0  =  -9  ■■  - 
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so  that  is  monotonically  decreasing  and  bounded  below  Va;.  Therefore,  Wx{t)  converges 

Vx  and  thus  =  Poo-  Since  i{P-^4>)  =  0  V  t  ^  {n},  it  follows  that  0(0  = 

kQ^P{t)4>iTNr)  V  t  >  ryv.,  and 

lim  0(0  =  k~^ Poo4>{TNr)  =  <f>co 

t~*oo 


6. a  Case  ki  >  0: 


Since 


_ ^ 


is  SE, 


V  io  ^  0  3  6(^to)  >  0  such  that  An-^in(  / 

J  ti 


(0  1  +  70^0 


dr)  > 


it-' 


Therefore,  V  3  0-  >  0  such  that  +  0))  =  ^nd,  thus,  {rO  is  an  infinite  set.  Since 

^(p-10)  =  0  V  t  ^  {rU,  it  follows  that  0(0  =  ko^ P{t)<f’{n)  V  t  such  that  n  <t  <  Tk+i-  It 

follows  that  j 

Kq 

where  p,  is  the  r-th  column  of  <p.  Further, 


IA(0I  <  l44.(^t-)l 


(~)O0.(o)i  yt>Tk  v2  =  l...,p 

kn 


It  follows  that  lim-^oo  0(0 
6.b  Case  Ici  —  Oi 


Since  is  SE, 


Therefore, 


ft 

lim  - 'T:r—  dt]  —  OO 


vCO 


0  1  +  70^0 


lim  Amax(-P(0)  =  0 


<—►00 


Finally,  since  0(0  =  k^^P{i)4>{Q)  V  t  >  0,  it  follows  that  limi_c«  0(0  =  0. 


1.  Smcc  Ar^;,)i/2  ’S  PE, 


3  d  >  0  such  that  A,. 


dr)  >  kq  -  /u'o  '  V  to  >  0 


ho  1  +  70^0 

Therefore,  {n-}  is  an  infinite  set.  Further, 

!0,(O)|  Vf  =  l,...,7) 


<  ^'o  ^  ' 

^'i  00 
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Consequently,  limt^co  <?5’(0  =  0  exponentially. 

8.  Since  =  0  V  t  ^  {r*,},  it  follows  that  4>{t)  =  P{t)<l>{Ti,)  V  t  such  that  n  <  t  < 

Tk^rx-  It  follows  that 

\Mi)\  <  ^  Vz  =  i,...,p 

Kq 

where  (f>i  is  the  z-th  column  of  </>.  O 


Proof  of  Theorem  2.3 


We  know  from  Lemma  2.3  that  the  columns  of  the  parameter  error  converge  and  remain  bounded 
in  norm  by  their  initial  values.  Now,  the  control  law  (2.2)  can  be  rewiitten 

u,  =  ri  lul  9i  z  =  1 , .  .  .  ,  m 


where  6i  is  the  z-th  column 
vector  w  is  defined  as 


of  0,  assuming  the  signal  vectors  W{  are 
w  =  [  zcf  ...  wj  ] 


properly  defined. 


If  the 


then 


=  r  +  O^iu 


where  0  =  block  diagjd,} 
bounded,  the  signals  arc 
between  w  a.nd  z/.,  and 


■.  The  vector  w  is  made  of  filtered  inputs  zmd  outputs.  Since  0  is 
all  bounded  over  finite  time.  Define  Hxl-u  3-s  the  transfer  function 
(0>  J/oo(0)  h''co(0  the  signal  vectors  w,  j/p,  and  -ih  when  0  =  0c<,, 


then 


Wca  =  PwiiDrH^  ~~  Coo)Dr  ~  DoqP’^r] 

Z/oo  =  kJpi[{A  —  Cco)Dr  “■  Dook^R\  ~  -I^yoorM 

z/^oo  =  H^uDr[[i\-C^)Dr  -  D^NRY^k[r]  =  lU^r[r]  (7.1) 

It  can  be  verified  that  is  stable  and  proper,  and  that  Hy^r  and  are  stable  and 

strictly  proper.  Furthermore, 


W  =  +  {9  — 


Since  9  converges  to  by 
Therefore,  u  G  Tco-  Finally, 


the  small  gain  theorem  (c/.  Desoer  k  Vidyasagar  [Si]),  w  G  Tec- 
since 


!/p  =  +  (d  -  doo)'^a’] 

lh  =  +  (^  — 


then  z/p  and  xlx  G  Lc,o- 


□ 
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Proof  of  Lemma  3.1 

We  will  prove  only  the  first  part  of  the  lemma,  since  the  second  part  is  the  dual  of  the  first. 
Let  define  jD,(s)  and  Ni{s)  as  the  z-th  row  of  D{s)  and  N{s),  then  by  hypothesis  (since,  from 
Definition  1.6,  the  set  of  observability  indices  is  equal  to  one  of  the  sets  of  pseudo-observability 

indices)  •  .  . 

Di{s)Nft.[s)  ~  Ni{s)Dfi{s)  and  dcjDi  ^  Pj  —  I  Vj  Vz 

Suppose  that  {Al,  Dl}  is  the  pseudo-canonical  left  MFD  with  indices  {p.},  then  (c/.  Definition 

1.12) 

dcjDL  =  P]  £)/_,<  max(pj,  Pmax  -  1)  FcfDi,]  =  /  Dl,{s)Nr{s)  =  ^ Lis)DH{s) 

Now,  if  Pk  =  Pm.ix,  then  the  matrices  {Nl,Dl}  defined  by 

jth  row  of  D2  =  jth  row  of  ZIl  Vj  Z 

kill  row  of  D}^  —  ^'th  row  of  D[^  +  Di 

jihrowoiNl  ^  ;th  row  of  iVx,  Vj  7^  A: 

A:th  row  of  yV£  —  kth  row  of  Ni,  +  Ni 

forms  another  pseudo-canonical  left  MFD  (vz)  with 

dcjDl  =  pj  <  max(pj,  p.T.ax  -  1)  ^c[Dl]  =  J  Di{s)Nr{s)  =  N[^{s)Dh{s) 

Given  the  uniqueness  of  Dr  {cf.  Definition  1.12), 

Dl{s)  =  Dl{s)  =>  D,[s)  =  0  Ni{s)  =  0  Vz  D{s)  =  0  A'(s)  =  0 

The  second  part  of  the  lemma  can  be  proved  in  a  similar  manner  by  using  a  pseudo-canonical 
right  MFD  instead  of  a  left  one.  D 

Gram-Schmidt  orthogonalization  with  memory 

Let  W{t)  G  be  a  matrix  of  rank  r  function  of  time  and  let  /z  >  0  be  a  constant  to  be  fixed 

later. 

1.  At  time  t  =  0,  apply  the  following  procedure: 

—  fcl^lth  column  of  W  s.t. 

Fi  =  IF^d)  where  =  niaxr- IHfil  and  minimum 
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had 


^2 


^4/^(2) 


W^ll  where 


(/- 


)H/(D 


PH^D  _  Jt(2)th  column  of  s.t. 

|PH^g)|  =  maxfc  and  minimum 

(<i  =  = «) 


PH(D 


where 


ppF^^  D  _  ^-('■)th  column  of  s.t. 

|14A;-D|  ^  niaxfc  |1F;S"“^^1  and  /:10  minimum 


u- 


V''  Y'^ 

-'’•fL-H-pd’-D  =  0 
yxy;  ^ 


Then,  the  matrix 


A'(0) 


il 

ID 


Dr 

|Drl 


is  an  orthogonal  basis  of  A(IT(0)),  the  space  of  dimension  r  spanned  by  the  columns  of 
PH(0)  The  order  of  selection  of  the  columns  of  1T(0),  ^  =  ^-.-T  is  uniquely 

defined  by  this  procedure.  Tlierefore,  the  matrix  A(0)  is  also  uniquely  defined. 

2.  Keep  the  initial  order  of  selection  of  the  columns,  for  the  orthogonahzatioii  of 

W{t),  t  >  0,  until 


3  1<J<r  31</<P  s.t.  +  h  < 


where  =  IF-  Then,  at  t  =  T(IK)  the  procedure  defined  for  t  -  0  is  applied  for  the 

computation  of  X{h),  and  a  new  order  of  selection  of  the  columns,  {k  '  }i(=t,(u-),  is  founo. 

3  Finally,  continue  this  procedure  for  the  orthogonalization  of  W{i),  t  >  U{W).  The  set 
{tk{W)}  are  the  time  instants  when  the  order  of  selection  of  the  columns  of  14  is  changed. 
The  matrix  X{t)  will  be  uniquely  defined  for  all  t  >  0. 

,.p,  t  •  i-  1  ...if],  H'  _  p.  leadin'^  to  T  =  Yr,  and  similarly  to  Py-  leading 

Hie  procedure  is  applied  with  D  -  X<.-.  leaain^  i,o  .a  ^ 

to  Uq.  The  advantage  of  using  this  Grain-Schmidt  orthogonalization  with  memor\  is^  - 

matnees  F,  and  Fo  Tre  uniquely  defined  for  given  matrices  P.  and  Py .  The  coristan  /i  is  diose^n 
sufficiently  small  that  no  vector  V;  may  become  equal  to  zero,  while  preventing  _ 

selection  of  the  columns  to  change  an  infinite  number  of  time  during  a  "  f  ]"'- 

Since  the  order  of  selection  of  the  columns  is  kept  constant  for  some  interval  of  im  / 

[Jo  are  piecewise  continuous  (the  continuity  property  is  discussed  m  greater  detail  in  the  pr 
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of  Lemma  4.2  in  the  appendix).  Finally,  note  that  using  the  Gram-Schmidt  orthogonalization 
procedure  with  memory  for  Px  =  I  or  Py  =  I  leads  to  V/  =  /  and  Uo  =  I. 

We  will  now  show  that  if 

h<~ 

2p 

the  Gram-Schmidt  orthogonalization  with  memory  is  always  well-defined  for  Vj  and  Uq.  In 
other  words,  we  show  that  |Vi(t)|  >  0  V  t  >  0. 

Indeed,  let  W  -  Px-  The  Gram-Schmidt  orthogonalization  procedure  with  memory  is  applied 
to  W  at  time  t  =  0  and  we  let  f  =  1, . . . ,  A^P  be  the  order  of  selection  of  the  columns  of 

W(0).  Given  the  properties  of  projections  (c/.  Definition  4.2),  as  long  as  iy;-|  =  >  0 


H/b)  =  [  0 


i±i. 


f  qr 

1  f  -Tu 

V'Arp  ^ 

T 

"  1  in 

iWpl  . 

1  [  nr 

•••  IWpl  J 

1  1 

Vi 

Kvp 

z  =  1,. 

nan  • 

IFvpl  j  1 

.  ini 

I'^Npl  \ 

Kvp  1 

r  r+i 

^  Np 

T 

i  =  1, 

■  avp- 

IFvpl  J 

L  iv,+ii 

IWpl  J 

1 


so  that  =  Np  -i-  Note  that  ll'id  has  i  columns  equal  to  zero,  when  i  =  0,...,A>  — 1, 

and  =  Q.  Therefore, 


max  T 


> 


Ap  —  I 
p  —  I 
1 


I  =  0, . . . ,  Np  —  1 


p  —  Np  -f  1 

So,  if  h  <  then,  whenever  the  order  is  preserved 

1 


2(p  —  AT  +  1 


z  =  0, . . . ,  A^/ 


1 


Consequently,  |Fi(t)P  >  2(p-i/WTn  ^  =  T  •  ■  ■  j  Afpj  V  t  >  0.  Similarly,  if  A  <  2[p-NpPi) 
the  orthogonalization  of  Py  is  well-defined  V  f  >  0.  Finally,  since  Np  >  1,  the  result  follows. 
□ 


Proof  of  Lemma  4.2 

1.  Given  the  properties  of  the  singular  value  decomposition  (c/  Definition  4.3),  VpPp^Up 
—  PflTi  P'^LT^'p  uniquely  defined.  Similarly,  UpUp  and  U^Uj  =  /  —  UpVp  are  uniquely 
defined.  Given  the  definition  of  the  Gram-Schmidt  orthogonalization  with  memory,  Vj  and  Uo 
are  uniquely  defined.  Therefore,  Q  is  uniquely  defined. 
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2.  If  Tk-i  <  t  <  tk  or  ii  tk  <  t  <  Tk  and  amjn(^p^(0)  >  ^hen  C’J’Jf)  -  C'J^(0  and 
cTmin(Co,(0)  >  ^fb-  If  tk<t<  Tk  and  (T^niPp)  <  ^p,  then 

CoM)  =  CoSt^j)  +  {Co{t)  -  Co{t^,))  +  {Pj{t)  -  Pjii:,))Qiti,)  (7-2) 

where,  from  (4.18)  and  (4.19)  with  (4.16)  and  (4.17),  ^min  (^0,(^5))  ^  (2.29)  and 

condition  (4.20)  with  (7.2) 

<T™„(Co.(i))  > 

Consequently,  cr,„i„(C'o,,(0)  >  (^/f')(l  “  I/*')  ^  V  t  >  0. 

3.  If  (TnuaiP^)  >  cp,  then  (Pj Pp)~^  <  and  Q  G  L^o  since  P,  Co,  and  Cq^  €  Leo- 

If  ^nUh)  ^  ^.nax(7"p^)  >  €P  +  (P  "  th^U  Q  €  Cco  sinCe  Ep'  <  l/(€p  +  Sp). 

If  cy.^n[Pj)  <  ep  and  <T.n,,(P7)  <  ep  +  (p  -  1)<^P,  since 

Cj(()  =  C  +  c;(i)^  Vn<t<n„ 

kQ 

then  IdfOil 

<7.nin(Co)  >  Cr„,„(Co)  -  (cp  +  (p  ^ 

and  therefore,  Q  —  0.  It  follows  that  Q  €  icx>.  ^ 

fl  =  = -CC_  +  = /}  +  (y,r 

1  +  ll^illoo  1  +  llV^tiloo  1  +  llt^dloo 

From  Lemma  2.3,  /?  G  7^2  CL^.  If  is  not  SE,  then  tt  G  L.nL^,  and  /?,  G  120  L^.  If 

is  SE,  then  limj-^oo  Co(t)  =  Cq.  Therefore,  3  T  >  0  such  that  |crn^n(Co)  -  ^inin  (C„-)l 
<  <t(1  —  1/a),  y  t>  T  and  /7c(0  =  /?(0  V  i  >  T.  Consequently,  Pc  G  ^2  fl  Loo. 

5.  If  limj_oo  ^(t)  =  0  then  limi_»oo  Co{t)  —  Cq  and  3  T  >  0  such  that  |o-nun(Co)  —  a'min(Co)I  < 
cr(l  -  1/a),  y  t  >  T  and  4>c{t)  =  </’(f)  V  t  >  T. 

6.  The  smallest  difference  between  C  and  Tk  or  Tk  and  C-+i  corresponds  to  a  variation  of 
a-min(Co)  from  a/b  to  a/a  or  a/a  to  a/b.  Given  the  continuity  of  the  singular  values  of  Co  in 
the  elements  ot  Co  (c/  Definition  4.3) 

{Tk-tk)  >  cr(l/a-  l/6)||Co||-' 

{tk-Tk-i)  >  a(l/a- l/6)||Co||a' 

7.  From  Lemma  2.3,  Co  is  a  matrix  of  continuous  functions  of  time  and  3  a  matrix  Coo  such  that 
lim<_coeo  =  Cco-  Consequently,  given  the  continuity  of  the  singular  values,  Ve>  0,  3T  >  0 
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such  that  Vt  >  T,  |crn.in(Co)  -  ^nun(Ccc)l  <  £•  Now,  supposc  that  <7rrun(C^)  f  cr/a,  t^cn  3e  >  0 
such  that  lo-n^n(C'oo)  -  >  e  and  3T  >  0  such  that  Vt  >  T,  |a■^^in((3o)  -  o-min((3oo)l  < 

Therefore,  no  more  jumps  can  occur  after  T  sufficiently  large.  If  ^min  (Cc»)  =  cr/a,  then  dT  >  0 
such  that  Vt  >  T,  k^„(Co)  -  cT^n(Cc.)l  <  cT{l/a  -  1/6)  and,  therefore,  no  more  than  one  jump 
may  occur  Vt  >  T.  Consequently,  {Tk}  and  {tk]  are  finite  sets. 


8.  P{t)  is  symmetric,  positive  definite,  and  monotonically  decrea.sing  between  the  covariance 
resetting  time  instants,  In  other  words. 


P{ti)  >  P(t2)  V  n  <ti<t2<  Tk+l 


Therefore, 

and 


P{tl)P{tl)  >  P{t2)P{t2)  V  n-  <ti<t2<  n  +  i 

Pl{ti)PAti)  >  Pj{i2)Ppit2)  Vr,  <P<t2< 


Consequently,  from  Theorem  5.10,  pp.  315  in  Stewart  (1973) 


a.(Pp"'(ti))>a,(Pj(C))  Vz  Vn<U<t2<r,+i 


(7.3) 


and  there  cannot  exist  more  than  one  time  instant  when  cr„^n{Pp)  becomes  smaller  than  cp 
in  between  two  resetting  time  instants.  Therefore,  the  set  {i^j}  is  a  finite  set,  since,  either 
(iP-,0rv;jT72  is  not  SE  and  {n-}  is  a  finite  set  (c/.  Lemma  2.3),  or  is  SE,  lim^^eo  Coit)  = 

C'J,'and  3  r  >  0  such  that  Q{t)  =  0  V  t  >  T.  However,  {fL}  could  be  an  infinite  set,  when 
^ is  not  SE,  since  i  could  be  iiihmte, 

(1+-,  v-^-o)‘/2 

9.  1;  we  can  show  that  UpPp^Vj  and  Rp  converge  when  P  and  Co  converge,  then  we  will  have 
proved  that  4>c{t)  converges  to  some  dcoo  ''hen  P{t)  and  d(i)  converge  to  some  Pco  and  d’oo- 

Part  1;  UpT-p^V^  converges 

Let  {cr,}  be  the  singular  values  of  Pj ,  then 


Np  , 

UpT,p'Vl  =Y,-,Up.VlP, 


i.l 


T  dT 
V 


where  Up^  is  the  z-th  column  oi  Up.  Therefore,  assuming  that  Np  stays  constant 

«(/pE;'iy)  =  i:,  JUp,u'^p+s[UpU^p,)){Pj  +  spJ)-y,UF.u^.P, 


■r  dT 

V 


^-{2a,  +  6a,)8a,  j  j 

^  p  .  NO—  ^ P. P 


1 


:UpV^8Pj 


{o'  i  +  Sc  t') 


^  {oi  +  8(7, YaJ 

j _ ^  7frr^  rrT \f  oT 

{o'i  +  Soi) 


(7.4) 


MS 


Now,  V  A  <  ^p/2,  we  can  define  a  unique  subset  of  distinct  singular  values  of  Sp,  say 
such  that 

+2A>(T,3+4A>...>cr,, +  2(.?-l)A  with  s,  =  Np 


CTs 


<7, 


—  2A  >  +  2A  <  .  -  -  <  cr^;  +  2(s,-  -St.'-l)  1)^ 


i  —  1, . .  .  ,q  with  5o  =  0 


(7.5) 


where  q  is  the  size  of  the  set  he.,  1  A  9  A  77p- 

Let  m,  =  s,  for  z  =  with  ELi^.  =  ^p.  Basically,  we  have  divided 

the  Np  singular  values  of  Ep  in  q  clusters  of  m.-  singular  values,  z  =  I,...,?,  such  that  the 
maximum  distance  between  a  singular  value  and  its  nearest  neighbor  inside  a  cluster  is^smaller 
than  2A  but  the  minimum  distance  between  two  clusters  is  greater  than  2A.  Then,  (7.4)  can 
be  rewritten  in  the  following  manner 


1  T\  ^  — (2(Tj'  -f  d(7,-)5iT,-  ttT  pT  ,  ^ 

S{UpT.-^'Vj)  =  S  L  ,  ,.'A  VpUpP,  + 


-UpUlSPj 

(<7,  +5<t,V  ' 


{(Ji  +  Scr.yaf 

-I  771 , 

(7.6) 


+  EE 

Z=:l  k 


From  Definition  4.-3,  |<5ct,|  <  \5P'p\.  Also,  Ep  and  Ep  +  dSp  are  >  {ep  +  dp)/,  and  \Pj\  <  Lu- 
Furthermore,  using  Lemma  4.1.1  with  (7.5),  V  A  ^  6pl2,  if  \^Pp  \  ^  then 


< 


A 


i  =  1. 


Therefore,  V  A  <  dp/2,  if  IdTp-^l  <  A,  then  (7.6)  yields 


,  2hNp  ,  Np  ,  2LopEf=i 

\6{Up^yvI)\  <  ,  ,  c  I  +  ^  .  c  I  + 


{ep  +  dp)3 

4  ho 


+ 


(ep  +  dp)3 


"  '  ‘  (ep  +  dp)A'^^P  '  '  {ep  +  8pY 

q  771 —  1 

((AT  —  +  (E  E 

ir=l  1:  =  1 


A 


^r,  ,  \^II\ 

A 


ai|dPj|  +  a2 


+  Q3A 


if  ai,  0-2,  and  03  are  properly  defined.  Note  also  that  if  IdPj'l  <  min(l,dp/4),  then 

ld(t/pSp'y/)|  <  aildPjl  +  (q2  +  ay\8Pj\^l'^ 


(7.7) 
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Now,  V  e  >  0,  we  can  choose  A  =  min(^,  ^)-  Then, 


Ve>0,  -^^^i2{a,e  +  2a,a^y2{a,6p  +  2a2y2a^'  2 

\5Py\<S  \6{Up^p^V^\)<e 


such  that 


Therefore,  Up'PpH^y  is  continuous  in  the  elements  of  Pj  as  long  as  Np  stays  constant.  From 

(7.3) 

Np[ti)  >  Np{t2)  Wn  <U<t2<  n+i 

Further,  Np  >  1.  Consequently,  if  P  converges  then  Np  converges  and  UpPp^Vp  will  converge. 


Part  2;  Rp  converges 

Given  the  definition  of  Up,  a.^^Pp)  >  ^.na.(S0  +  Sp.  If  \6Py\  <  Sp/2,  using  Lemma  4.1.2 

\6{UpUy)\<^\5Pj\  (7-8) 

Therefore,  UpUp  is  continuous  in  the  elements  of  Pj  as  long  as  Np  is  constant.  The  same  is 

true  for  U^Uj  since  U^Uj  =  1  —  UpUp . 

The  singular  values  of  Co^UpLip  have  the  following  properties 

O'!  ^  ^2  P  ■  ■  ■  P.  ^  ^Np  +  i  —  0 

Since  A-  =  niCoMpUy).  using  Lemma  4.1.2  and  (7.S),  if  \5Py\  <  Sp/2  then 

,  -  „  ,  2  NIGollco  .  r  n'l’' 

|0Aa-|  <  ^ I 

Op  (J 


The  singular  v^ilues  of  CqU^UJ  have  the  following  piopertics 

^  cr2  >  .  .  -  >  (crp_/Vp  ^  cr/^)  >  ^Tp-Wp+l  ^  0 

Since  y  =  TZ{CoU,Uy)^,  using  Lemma  4.1.2,  (7.8),  and  the  fact  that  UeUj  =  1  -  UpU^,  if 
\SPy\  <  Sp/2  then 

Op  CP  CP 

When  the  order  of  selection  of  the  columns  stays  constant  in  the  Gram-Schmidt  orthogonahza- 
tion  procedure  with  memory,  it  can  be  verified  tliat  if  \dpy\  <  6p/2  then 


3  r/i  >  0  s.t. 

\6V,\ 

<  rji\6PA'\  < 

3  7^2  0  S.t. 

IV.'ot 

A 

A 
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2t]i  b\\Co\\c 

6p  O' 

2;/2  a||Co|lc 


T| 


■]SP 


a 


(7.9) 


a 


(7.10) 


Therefore,  as  long  as  the  order  of  selection  of  the  columns  stays  constant  Vj  is  continuous  in 
the  elements  of  Px  and  Uo  is  continuous  in  the  elements  of  Py.  Furthermore,  since  P  and  Co 
are  bounded,  because  of  the  constant  h  >  0,  the  order  of  selection  of  the  columns  will  always 
remain  constant  for  some  minimum  amount  of  time.  Therefore,  as  long  as  Np  is  constant  and 
the  order  of  selection  of  the  columns  is  constant  in  the  Gram-Schmidt  orthogonahzation,  Rp 
is  continuous  in  the  elements  of  Pj  and  Co-  Finally,  if  Pj  and  Go  converge,  because  of  the 
continuity  property,  there  will  be  only  a  finite  number  of  changes  m  the  order  of  selection  of 
the  columns  for  the  orthogonahzation  procedure,  he.,  {4(P a:-)}  and  {tk{Py)]  will  be  finite  sets 
and  Rp  will  also  converge.  □ 


Proof  of  existence  and  uniqueness  of  the  solution 

Assume  that  {Ap,  Bp,Cp}  is  a  minimal  state-space  representation  of  the  plant 

P{s)  =  Cp{sl  -  Apy^Bp 

Define  (Aa,  Bx,Cx}  as  a  minimal  state-space  representation  of  the  controller  such  that 


Cx{sl  -  Ax)  'Bx 


1 


4 

sip 

s‘"^Ip 


Then,  the  plant  with  observers  ilP 

.)  t,.(2) 

•>  ^ 

is  described  b}' 

ip 

=  Apxp  -f  Bpu 

^x 

=  Axxx  +  Bxu 

■^x 

=  .4a.ta  +  BxUp 

Vp 

=  CpXp 

=  Cjii*’ 

= 

Define  xpA  as  f  x'p  ] 

,  then  by  using  (4.21)  and  by  properly  defining  the  constant 

matrices  {cf.  Sastry  &  Bodson  [3],  section  3.5,  pp.  135-136) 

Xp\  “  Am^-PX  +  "1“ 

Up  —  Brn^FX 
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Since,  model  matching  must  occur  when  (jic  —  0 

Crn{sI-Am)~"Brn  =  H{s)Co 


and  the  model  and  its  output  can  be  represented  by 


—  Ajn^m  d"  BmC/QT 
Urn  —  C-m^m 

The  representation  is  non-minimal,  but  it  can  be  shown  (c/.  Sastry  &  Bodson  [3],  section  3.5, 
pp.  136-137),  that  the  additional  modes  of  A^n  are  those  of  Nr  and  A,  stable  by  assumptions. 

Now,  let  e  =  xpA  —  x,„,  then,  if  the  constant  matrix  Rm  is  properly  defined  (c/.  Sastry  k 
Bodson  [3],  section  3.5,  pp.  137-138) 

e  =  /l„,e  -f  Bm(f>l‘^m  +  Bm<^jRm^ 

Cq  — 

where  u;„  =  is  a  bounded  continuous  exogenous  input.  Finally, 

if  {A^,B4,,C^,D^]  are  properly  defined 

x^.  —  A^.x^.  -f  B^.xpx 

A  =  C^.x^  -f  D.^ajp 


where  the  modes  of  A,i,  are  the  poles  of  l{$).  Let  tr  —  where  are  tnc  corresponding 

model  signals,  then  the  overall  adaptive  system  has  the  following  form 


e 

Cj. 

p 

4>c 


—  A-m^  4"  BmAc  ^rn  "h  BmAc 

—  A^pCr  "t-  B^pC 

_  ^{^4'  "b  +  PmY 4> 

~  ^1  -f  7(^0  +^nO^(e^-  +  VV.) 

_  P{^4i  +  Pm){^4’  ~h  PmY P 

^  1  -1-  7(e,/,  -f  +  pm) 

=  cp  +  PQ 

—  C 

—  xl>  P  0 


P(0)  =  P{Tp)  =  kol 


(7.11) 


where  Am  =  [Cp{sl  -  Ap)-^  B^  +  DpCm]{sl -  Am)~^  BmC^r  is  a  bounded  continuous  exogenous 
input.  The  matrix  Q  is  a  piecewise  continuous  function  of  time  and  is  continuous  in  the  elements 
of  A  and  P  in  between  discontinuities.  Therefore,  the  overall  adaptive  system  can  be  put  under 
the  form  of  (4.29)  with  /(t,x)  piecewise  continuous  in  t. 
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Now,  w'e  can  use  Lemma  4.3  to  prove  ejdstence  and  uniqueness.  First,  we  willj.ssurne  for 
simplicity  that  h  =  0  (no  covariance  resettings).  Let  xo  =  3:(0)  and  assume  that  Q  0  V  >  , 

then  from  (7.11),  f{t,x)  is  continuous  in  t  and  a:,  and 

l/(L^o)|  <  +  15m||i?-ll^(0)l  +  |B^I)le(0)l  +  lA,^|le,(0)l 

+  (|B,„||K||c.+5^oniax(l,7-'))l<?^(0)H-5^-omaK(l,7  ') 

<  /l7(le(0)P‘+le.(0)n'/'  +  A:2  =  /io 

if  kr  and  k.  are  properly  defined  positive  constants.  Further,  let  ro  >  0  finite,  then  V  x  G  23.„(xo) 
and  V  t  >  0  it  can  be  checked  that  f{t,x)  in  (7.11)  is  locally  Lipschitz: 

\f{t,xi)  -  J{t,X2)\  <  (i.d,„l  +  |5mil/?Tull<5^i|  +  1-S^l ) 

+  iFi^l|C^l|e2l  +  |Cv,l|e.,l  +  lld’nJUKl'Pal  +  lF2|)lP2l)lei  -  £2! 

+  +^(1  +  min(7,  l))lC^|[min(l, 7"')  +  1^011^-11^21  +  \Ci,\\er,\ 

+  ll'/’mlloo](l<?^2l  +  IPlDlPaDkri  ”  1 

+  (|7?,„|17?„lle2l  +i7min(l,7'')lP2l)l'/>i  -<^2! 

+pmin(l,7~’)(idi!  +  l^il  +  IPzDlPi  “  P2I 

<  (.Li(le(0)l"  +  ler(0)r)'P  +  -  ^^al  =  lo\xi  -  X2I  (7-12) 

if  kj  and  k^  are  properly  defined  positive  constants.  Also, 

mav(/:3,  ^--i)  ^  <  A  <  =  ke 

Li  +  ko  '  ho  max(/:i,/:2) 


Therefore,  from  Lemma  4.3,  if 

do  =  |min(p,--i^,x)-^  with  0<p<l  xexp(x)  =  Vo 

Iq  /Cg  +  To  ‘0 

then  (7.11)  has  a  unique  solution  on  (O.^l-  From  Lemma  2-3.  k"”';' rp,l°tfT,  ^ 

solution  exists,  then  <  |^(0)|  and  |P(l)l  <  *o.  Therefore,  ld(«o)l  <  |«0)  ,  |P(«I  S  lo. 

and  (|e(d„)|“  +  |e.(«o)P)'/"  <  (|e(0)P  +  l£.(0)P)''’  +  Then,  it  can  be  venfied  that  V  (  >  «o, 


l/(l,aso)l  ^  h,(|e{do)l' +  |e.(do)P)*^^  +  L,  — /i| 

l/((.ai)  -  <  (l-bOl^olP  +  +  Fi)lii  -  III  =  hlai  “  asl 

<  (/o  +  ^'^3^o)|-T;i  —  -^21  V  Xi,  X2  €  Pro(2:(do)) 

Therefore,  if  6^  =  ^  unique  solution  on  [<5i,(5o]-  We  can  keep  extending 

the  solution  in  this“  manner  indefinitely  since  liim_.oo  E.=o  unbounded.  However,  at 

t  =  t,,Q  changes,  Q  =  Pj>{Pj Pj,)-\Cl-Co)  as  long  as  arni^iPj)  >  ^P-  Then,  it  can  be  prove  , 
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similarly  to  the  case  Q  =  0,  that  there  exists  a  unique  solution  V  t  €  This  reasoning  can 

be  easily  extended  for  all  the  subsequent  time  intervals  and,  also,  when  there  is  some  covariarice 
resetting  (k^  >  0).  Since  the  time  intervals  between  the  time  instants  {r;,},  {4-},  {Tk},  and  {^} 
are  always  bounded  below  by  St  (if  we  assume  that  the  covariance  resetting  are  synchronized 
with  the  time  instants  {f -ij-}  when  necessary  (k^  =  St)),  the  interval  of  existence  of  the  solution 
can  be  extended  indefinitely  and  the  system  has  a  unique  solution  V  ^  >  0.  □ 


Proof  of  Lemma  4.7 


The  proof  is  similar  in  its  construction  to  the  proof  of  Lemma  C4  in  loannou  &  Tsakalis 
[90].  From  Lemma  4.5,  u  G  Too-  Now,  assume  that  L(s)  =  diag{/(3)},  with  I(s)  polynomial, 
stable,  dl(s)  >  d,  where  d  is  the  maximum  relative  degree,  (degree  of  numerator  -  degree  of 
denominator),  of  all  elements  of  //“^(s).  Then,  using  Lemma  4.6,  T"'[u]  =  {HL)-'^[y\  €  Too 
and  lim(_-oo  =  0  (if  d  =  0,  the  proof  stops  here).  Since  u,  u  €  Too,  it  follows  from  Lemma 

4.4  that 

—  e  Too  and  is  continuously  differentiable  Vj  =  l,...,d 

dV 

Since  limi_oo  T'^  [u]  =  0,  V<5  >  0,  37’  >  0,  such  that  Vi  >  T,  [u.j  <  d,  V  f  =  1 , . . . ,  p,  where  p 
is  the  dimension  of  H .  Furthermore,  by  the  mean  value  theorem 


^r'[u,]  =  r^[u,]it+At  -  i-'Wih  =  t  <  i*  <  i  +  Ai  vf  =  i,..-,p 

t  at 


so  that  Vi  >  T 
d 


__  ^-1  f ,, .1 ,  i 


|lr'MI<  sup  {|Ar‘i„.ii)<  A  +  a.a(  v. 

'dt  ^  ‘J'  -  At  [i,(+Ai]  dt^  At 


for  some  constant  k  >  0,  since  ^L-^[u]  G  L^.  To  prevent  proliferation  of  constants,  we  will 
hereafter  use  the  single  symbol  k  to  designate  an  arbitrarily  large  positive  constant.  If  At  is 


chosen  =  then  Vt  >  T 

\jr'iu.]\  <  k  6'/^  Vi 


By  a  similar  reasoning,  \/t  >  T , 


for  some  constant  k  >  0,  since  ^^T  ^[u]  G  T 
=  ^  then  'i  t  >  T 


V;  =  l,...,d  Vz  =  l,...,p 
V  j  =  1, . . . ,  d  (zz  G  Loo)-  If  Ai  is  chosen 


\^l-^[u,]\<k8^^'^k  vi  =  l,...,d  Vz-  =  1,. 
'  dV 


■,V 


154 


so  that,  \'t  >  T 

\ui{t)\ <  +  e(0  i  =  l,...,p 

where  e{t)  is  an  exponentially  decaying  term.  Consequently,  limi_oo  u  =  0. 
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